Every system has downsides. The question is, is "having to make an immense moneetary gain at the cost of your connection to the trees you planted and the closeness of your neighbors" worse than the system we have now, and for whom?

Again: No system is perfect. It seems to me that the Georgist approach would tend to lay the tax burden more evenly on people of all levels of wealth, even if it does force some people to sell and buy.