And I do believe you have control over how your town is shaped. You can shape zoning and ordinance laws to prevent certain types of projects - whether it be fast food, drive-thrus, strip clubs, or dispensaries. Housing developers are trying to make money, and if you make it difficult to make a profit, they won't build.
It truly is about the character of your town.
If your current residents wants to hire a teacher, firefighter, restaurant worker, etc that person may need to move in from out of town. So you can decide how / where people live through zoning.
You also decide how easy/hard it is for people to live in your town, and thus how much goods and services costs.
It's entirely in your hand...
I just think most people focus on one aspect (buildings near them) and don't think about other tradeoffs (all the consequences of how/where people your town 'hires' could live as the economy grows). It's complicated and the whole point is you get to work with your zoning board to make those decisions informed by the data and needs of the town.
You are arguing two completely unrelated topics as if they are connected: zoning and welfare.