Yes, there are often undeserved windfalls. But I think you're missing something? Buildings don't come out of nowhere and they don't maintain themselves. Abandoned buildings deteriorate. They need to be protected. (Sometimes, unfortunately, from the tenants.)

There is a social role to be played here, whether homeowners do it themselves or landlords do it.