I think people are quite aware of that line of thinking. Most people who live in slightly unpopular areas live there because they couldn't afford other places and now when the area has become more desirable they fear being pushed out. This is an especially legitimate concern if you are renting, since building might very well rise demand more than it does supply.