Valuable land is a product of labor, even if only due to being within the boundaries of a secure and orderly society.

Armies, judicial systems, etc, plus labor to bring about the goods and services. Plenty of examples of prime land decreasing in price due to the labor around it not being of sufficient quality/quantity.