To get a taste of Athos you can watch this short documentary online, where the monks gave unprecedented access to the tv news show 60 Minutes: http://www.cbsnews.com/news/mt-athos-a-visit-to-the-holy-mou...
I should add that the book I previously mentioned, "The Mountain of Silence," provides a very approachable introduction to Orthodox monastic life (which is really the Orthodox Christian life lived in a particular mode), without requiring any religious background. The author himself is writing from the perspective of an anthropologist, although I think at the time he was also a lapsed Orthodox Christian. Suffice to say that a relatively non-religious friend of mine really enjoyed the book. :)
All that being said, more info on visiting Mt. Athos is here: http://www.athosfriends.org/PilgrimsGuide/planning/ I should note that Athos does not allow women visitors, but there are similar monastic communities for women. This is not at all intended to be sexist, but is part of the asceticism of Athonite monasticism in particular. Previously women have settled on Athos, and the monks simply let them live there -- they ended up leaving of their own accord. Also, the monks sheltered families of Jews during WW2, which of course included women.
Edit: I forgot to respond to your question about joining. More details can be found here: http://orthodoxwiki.org/Monastic_Ranks