I feel you. I tried to make it easy to toggle on and off in case you needed to check something in color, but it's a bit of a double edged sword in that it can be too easy to turn it off and leave it off.

That's a big part of why I added the saved/excluded sites functionality, so you could add it for sites that are usually time wasters like reddit or facebook, or exclude sites from being gray that you need for work.