Someone else should pay the taxes for them?
Either your tax would come entirely from income - huge handout to homeowners / cost to non-homeonwers - regressive. OR your sales tax would be so crushing that no one would ever buy anything in your community.
Or you could live in a fantasy land.
There are many ways to fund the local area. UK has explicit “council tax”, based on property value, but not as a fixed percentage, rather more linked to the percentage of the house value - so your tax bill doesn’t double just because other peoples houses appreciated. These are paid for all houses, and go to the local government. I think this is indeed one of the main sources of income for local councils.
But for example for capital gains tax, which goes fully to the central government, primary residence is excluded.
This means that people buying property as investments end up paying CGT but not ordinary house owners. If investment properties are rented out, it is the renters that pay council tax, as the actual inhabitants of the properties.
There are so many ways to skin a rabbit with taxes, you could tailor it pretty well to discriminate between homeowners and investors.
I'm not sure I support land taxes etc. but this at least deals with your objection.