Even the most die-hard libertarian economist believes in Pigouvian taxes to address externalities. If vacant buildings are an externality cost, they should be taxed.