* The value of land is largely created by public services such as schools, infrastructure, parks and public transport. Therefore, it makes sense to recover this value through taxation.
* Almost all taxes reduce or distort what is taxed. The supply of land, on the other hand, is fixed and cannot be reduced. This way, public services such as schools can be paid for without distorting the economy.
* Property cannot be hidden or moved to tax havens.
* Land taxes prevent vacancies and thus speculation. The reduction of vacancies also helps against urban sprawl.
This setup works for a very small percentage of the population. If you want an access road to your property you'll need to purchase the right of way from neighbors. And you'll have to live with the fact that the land you bought might not ever sell. As a primary property it's going to be extremely hard to get financing for any improvements so most of these properties are relegated to a cabin in the woods, vacation home.
There's no some god-given justification for taxes.
We have them because:
a) somebody can enforce their payment
b) societies need a money pool to do public things
c) societies need to encourage/discourage some things
A country could opt not to have taxes, and not maintain an army for example, and live it to the goodwill of the citizens to build infrastructure. That couldn't would be stomped by one that did have taxes and used them to build a good army. So that doesn't work out that good...
Now, assuming a society decide it needs taxes, what taxes to have is more a question of "how much money are needed" and "how to present it nicely" and "what to encourage/discourage".
Regarding "how much money is needed", the justification for property tax is simple: if income tax money aren't enough, governments might add not just property tax, but even a breathing tax. On the plus side, property is difficult to hide (as money would be e.g. in the Kayman islands).
Regarding "what to discourage", the justification for property tax is, not to hog down property and prevent its use.
You also want to get some of the value the community/government creates in an area and pushes property values (not just market value, but also use-value, like having a school nearby) up back.