I think it got mainstream after the RubyOnRails Wave that made a lot of (mainstream) programmers (that only use what other use and/or is popular) accept dynamic languages. And when BackSlash came (Ruby is Slow, RoR is full of Magic) python w/ django was the dynamic lang that clinged on shore. Not accidentaly since it already had pretty clean core and a lot of libraries (it always had more libs than ruby). Now everybody uses it.
If you look at the similar languages w/ a lot of libraries and bindings php/Perl/Ruby/Python it's not weird that it's popular and I would say that it is the simplest/cleanest.
Which ones did you mean as simpler?
You should remember there's a lot of Python usage besides web, like in the scientific community.
I back then used it for a lot of things and most weren't related to web. But I think it made the biggest jump after Ruby backslash. From quick peek at TIOBE:
""" "Programming Language of the Year" award winners is shown below. The award is given to the programming language that has the highest rise in ratings in a year. """
2007 Python 2006 Ruby 2005 Java
Most of the code that gets written in Python has nothing to do with web development. Web development is just high-profile.
But as I also said, Python had a lot of libraries back then 10 years ago when I used it with Zope, WxWidgets, PyGame, CherryPy, ...
And in last paragraph I try to say exactly what you said in relation to Perl and other languages of this kind.