I'm specifically saying don't distinguish. The public should strongly incentivize against leaving houses vacant, whether you're a landlord without a tenant, a speculator with an empty house, or some rich dude with 50 houses he visits for a week per year.