In GIMP I am able to do the following:
Tools -> Selection Tools -> By Color Select (Shift+O)
Click on the single color I want to keep
Select -> Invert (Shift+I)
Edit -> Clear (Delete)
This allows me to remove all but the one color I clicked on. How can I do this in Python with opencv?