If you're lucky enough to buy red on the right spin, roulette is a great investment.
Which is silly because you'd never invest that way.
As an individual investor you probably don't care about other people's returns, but an economic analysis has to look at the average case and not at what lucky/sophisticated investors get.
Which is same conceptually as "investing on average across the entire country". So, while I'm not encouraging real estate investing, what you are saying runs completely against the generally accepted conclusions of Finance Theory.
However, the average rate of return on real estate is pretty consistent. That would argue that although areas appreciate at different rates, over a long enough time period, they returns are all pretty small.
As to your second observation, I look for cashflow, appreciation is just a side (but not necessary) benefit. Appreciation gains depend on selling to the market, and with a shorter timespan for the deal, is usually referred to as flipping.
To me, flipping is similar to speculation.
Cashflow is similar to investing in a business/going concern. The value of the business can go up or down, but the monthly payments keep showing up in my bank account.
The article talked about investing, but I would rarely consider one's personal home an investment for reliable financial gain. Far too many costs involved that are not offset by income, until the final sale. And the sale _might very well_ depend on timing and other people's (market) opinion to get the most return - Not something I want to depend on.
So for me, the way I invest, real estate has been a rewarding investment.
Have you actually looked at the Schiller time series data? It's an average of regional data. It's entirely appropriate to consider Schiller's subindexes if you live in one of the 20-30 metro areas they pull from.
- Just because some gets you a positive return, doesn't mean it's an ideal investment. If you can get a 6% return, then an investment getting you 3% isn't that great.
- Real estate is local. Schiller is looking at average across the entire country. Areas appreciate at different rates. If you're lucky enough to buy in an area where prices are rapidly appreciating, then it can be a great investment. If you're buying at the top, then it can be a really bad investment.