I wonder how much of Perl's reputation is based on these kinds of formative experiences. I love Perl, but I'm realizing that everyone had their nemesis in sitecounts.pl, or traffic_reports.pl, or partnerpayments.pl, or wtf-how-did-this-ever-work.pl, and unfortunately didn't draw the same conclusions about Perl that I did.
Good to see the tradition continues. Remember this is write to do stuff everyone knows on the team.
It's like it triggers some primitive release of testosterone which results in developers competing to fit the most functionality in one regex filled line of craziness. Hilarious to watch. Hell to debug.
It's scripts like these that spawned the meme of replacing people with scripts; because that's what these massive scripts did: automated away entire departments, or negated the need to hire for a department all together. Which is important when you're a two man company and all of a sudden you've discovered you need to process $100k of credit card transactions from yesterday, and you better get started on it because there's already another $300k in transactions generated today. It's only one script, so there's no need for revision control. Damn, there's only one guy working on it, it can run out of his home directory. And of course, it was so successful, successfully a blackbox, he's asked to automate some other task, which is only related because there's some slight dependency, and, well, it's a dependency, so let's just put it in the same script we already run. Rinse, repeat.
Were these scripts terrible? Of course. But they were the work horses of the Internet and any company with two CPUs to rub together in the 90s. There's a reason that "perl is the duct tape of the Internet" was a saying in the mid- to late- 90s: because it was.
These scripts work perfectly fine if the person who wrote them and fully understand them runs them, yet inexplicably fall apart when someone who didn't write them run them (similar to [0]). These scripts can smell the fear of the new guy put in charge to maintain them. This is where heisenbugs roost and schroedinbugs become the stuff nightmares are made of, despite that they had most likely been running without issue for months or years since the guy who wrote them left.
[0] "Tom Knight and the Lisp Machine" http://catb.org/jargon/html/koans.html#id3141171
Don't blame the boy.
(And remember, he was raised by wolves. Yeoowww!)
In fifteen or twenty years we'll be reading rants from people who had to cut their teeth on some overly designed, needlessly abstracted, difficult-to-build-all the-dependencies-for rails app.
It's cyclical.
Note that I'm referring to the first or second edition (maybe the third); I understand that the fourth edition is just recently out.
TIMTOWTDI
If folks have enough programming experience with other languages, it's easy to write Perl that looks more like those other languages, but unfortunately the moment a developer gets overworked or wants to show off (opposite extremes, really), Perl can devolve faster than some other languages because so many tricks are possible when vigilance is not maintained.
I've had decent success with making one-class-per-file with MooseX::Declare and Method::Signatures::Simple, but you really have to have a good code review process and rock solid developers to make it happen.
I don't think it's the languages fault, as this can happen just as quick in (say) Ruby code, and you can write extremely bad code in any language. Those other languages tend to be slightly faster to develop in though, as you can forget all of the need to write things like "my" and the reference syntax. Things like Python and Java have some resistance to "having fun with syntax games", but fall into other traps where interesting syntax (or architecture games) become fun or quick shortcuts.
On one end, part of Perl's problem is not Perl at all, just that it was historically the first thing people learned after Bash, and often those folks really didn't learn to program yet. On the other end, it is easy to go crazy with it.
(There is also a skill level issue; regexes are much easier to understand than parser generators, so a lot of people try to implement a parser with regexes.)
I love to read other programmer's battle stories! (I am currently reading "Coders at Work" and really enjoying it).
Thanks for sharing!
Addressing some of the other comments; Perl and the Perl community itself is so far removed from macho ... its still one of the kindest, most intelligent and beneficial public communities online .... if someone feels emasculated by just reading someone's code; don't mistake that for the original coder's intent was to emasculate.
Perl is the programming language that I would want with me if the world was coming to an end (asteroids of course) and somehow I could help save it with getting the damn lasers to work to blow up the asteroids ... if it takes a 150 char regex then so be it.
One thing I do remember distinctly about Glenn's time in the catalog department was this terrifying 60k Perl script I inherited from him called sitecounts.pl. This script examined all the various catalogs (books, reviews, etc) and attempted to generate some interesting stats about them. One day it just broke, and since it was used in the catalog build process to verify that things were sane, it needed to get fixed pronto. The code was plenty confusing, but what was the worst part was the extent of the right margin creep, I'm talking 150+ character lines -- not exactly easy reading on my crappy 15" X-terminal. I felt like a character in a HP Lovecraft story, slowly descending into madness as I learned more about the horrors of this script.
I ended up maintaining and adding to this script my entire first stint at Amazon. Eventually as I added features and changed things, it slowly got made sane over time, save for a little bit of madness that I kept in there just so I'd have a reminder of what it was like.
Ah the 90s. Good times.