Why does it matter if someone lives there or not? Slap a land value tax on it, high enough that if the owner doesn't make use of it they'll feel it.