You'd think smaller towns could just let people build some more houses. Adding more people to e.g. Manhattan is tricky because land is scarce. But a small town should have some adjacent land available, that could be allocated for building more homes.