Have been thinking a lot about this.

There are more ways to make an impact, such as earning a good salary and re-investing / donating to build trees, renewables or serve any of the UNDP goals that are helping society.

In fact that is probably more impactful that personally picking fruit in the garden.

I guess it just depends on the place itself not being generally net negative to society compared to the impact you can make with it.

Here is a good primer: https://80000hours.org/