I imagine no one would be offended had it been couched in different terms as desiring a more diverse and vibrant community with more of a future.

Agism or not, it's generally true that small towns with a lot of old people are typically towns in their death throes and white enclaves are typically practicing some form of racial exclusion.