Exactly. High income neighborhoods aren't just randomly scattered around. While I have no interest in living in a high income neighborhood per se, I want to bike to work, be away from major highways, have green spaces around my house, feel reasonably safe and be reasonably close to an at least a half way decent school and all places that fulfill those criteria are almost by definition high income neighborhoods.

I think that's part of the key, if you're going to try to outshine your neighbors you're only wasting money for a momentary victory. I had an uncle who told me he was glad he moved from the neighborhood he was in for that very reason.