I am aware that they must find it fun, but I am challenging the ethics of this 'fun'. I think this information should not exist anywhere and even if it did, it shouldn't be made public.

Geocaching and trying to gather as much privacy sensitive information about the people around you are two different things. With geocaching there aren't any parties involved that are unaware of the activity who are still negatively impacted by it.