These sorts of suggestions generally seem hugely biased towards buyers at the expense of everyone else.
Yes, the investor makes less, but the expected result is less supply so rents are higher, not the same supply but with strictly lower rents.
Higherand higher marginal property taxes for owners of non primary residences disincentivizes owning secondary residences, hence disincentivizes renting, hence decreasing supply of buyers wanting to buy homes.
There will still be first time buyers or people moving, so builders should still have incentivize to build homes, hence supply should not cease to come online just because there are fewer landlords.
Personally, I think LVT would be the best approach.
Vacation homes are in beautiful tourist areas. That can be a problem for local workers but I doubt this is much of a problem for most markets.
* https://www.businessinsider.com/real-estate-apartment-rent-p...
* https://www.propublica.org/article/yieldstar-rent-increase-r...
I've believed for a long time that heavily taxing income from second+ properties, similar to capital gains, would help reduce rent-seeker hoarding, to help free up and reduce the cost of properties for primary-residence owners.