I think part of the source of that myth is that middle-class Californians look wealthy to the middle class citizens of the more affordable regions they are moving to. Because while the cost of living is lower, salaries and wages generally are as well.