>I would imagine you'd be treated worse by the average person, if you're signaling wealth.

This runs completely counter to my personal experiences and observations.