There's a Chrome extension that does something like that: https://chrome.google.com/webstore/detail/high-contrast/djcf...
I've resorted to using "Change Colors" (https://chrome.google.com/webstore/detail/change-colors/jbmk...) - which has the advantage of allowing me to specify my own fonts too.
It doesn't always work.
I also use Readability.
It would have to be semi-intelligent to adjust the brightness accordingly (so it would work both on light-gray-on-white sites and dark-gray-on-black sites), but having an in-browser contrast control would be great.