If someone inherits a single family house and don't view the property as providing enough value as a residence or rental to cover the land taxes, then they should sell the property or redevelop it at a higher density that better matches the value of the the land.
Of course land should be producing economic value. If it doesn't or thr value produced doesn't match the land's value, then something is wrong.
A high property tax based on land value would suggest that all the places people need to live would need to be generating income, have a high income for the family, or they'd need to move into a place where that land value is distributed across a wider base of households.