For instance, there's loads of large family houses being occupied by empty-nesters, while those trying to raise a young family are squashed into undersized townhouses.
Shifting the cost-base from "pay a huge mortgage and a tiny property tax" to "pay a moderate mortgage and an moderate property tax" means it's more likely to be worth the hassle of moving to a smaller house when you no longer need the space.
Longer term, the impact on rental costs depends on whether you think this policy would increase the amount of housing available for people to live in.
Where I live, many properties are bought and kept empty - the rental income isn't worth the hassle and they are being held for capital gains. High property taxes would presumably result in some of those properties being sold to occupiers.
Consider an extreme case - a land value tax of 20% (meaning you pay the government the full value of the unimproved land every 5 years). Land values would plummet, right? Lets say it were introduced over 30 years, so prices could adjust smoothly instead of crashing. What does the steady state look like after 30 years?
Policing is definitely possible, but I don't think the added cost and operational complexity make it advisable.