As things stand, your theoretical conservative isolationist is unlikely to even meet a fellow Esperanto speaker outside of the community of Esperanto speakers. There are so few Esperanto speakers that if one wanted to actively use the language in any way, one would have to engage with its community. Some Esperantists do keep their distance from the core, rather fanatic community and they try to use the language purely as a means of communication or as a game. However, the actual organizations that provide most of the infrastructure to actively use the language are bound quite closely with the community, and a certain set of shared cultural behaviours and acceptable political boundaries has now arisen within that community.