Yeah, I find the same thing. I am "red green colorblind" but my experience is that there is a long tail of effects beyond the simple rules that you read about.

I'm friends with a lot of visual artists and designers and a subset of them clearly have color vision beyond the ordinary. That is something to be aware of as a designer, that even non-colorblind people may not be able to detect some of the subtle differences you can (especially if you have a nicer/better calibrated monitor).