Either your line of work demands you be at a specific location, or you're competing with the 0.001% of the entire world for a remote job, with employers that would rather do without than make do with sub-superlative people.
I'm happy to live in a well-built, quiet condo that I pay a bit more for than "standard" condos or whatever. Don't really need a house. But even these are nearly impossible to come by. There's practically zero inventory.
Your mileage may vary depending on much or little you value things like remoteness, lack of traffic, mountains vs desert vs forest. Yes, if you're a hardcore mountaineer it might be tough to beat the north Cascades but for the rest of us there are a lot of good options.
I can summarize a lot of the comments in this thread with:
"But I want it!"
The city isn't obligated in making areas you like affordable to you.
I wrote a bit about this recently:
But oh no, they don't have Seattle's views? Cry me a river.
If you ever find yourself in Northern Wisconsin, sea kayaking the Apostle Islands is pretty spectacular. Check out http://livingadventure.com/ for more info.
In some places there is also racism to various extents, but even in the absence of racism, there is just a significant handicap to not being a member of the default group.
In contrast, I fit right at home in a cosmopolitan place like Silicon Valley where there isn't really a default culture. Of course, it's basically a global phenomenon that cosmpolitan cities tend to be far more expensive than the cities that more closely reflect the local culture.
Note that the proportion of blacks doesn't really contribute to a cosmopolitan city - it just means the city has two dominant native cultures instead of one.
http://www.businessinsider.com/the-11-nations-of-the-united-... is a useful lens to consider in this matter. Similar analyses from other lens with largely similar results have been applied.
If you want a house like that, and you're not super wealthy, find a remote gig and move outside the big tech-boom cities. Here in the Rust Belt, houses like that are very affordably priced.
If enough people with tech-generated wealth start living and spending money here, it'll make progress solving the regional inequalities that are driving support for Donald Trump.