Actually large private enterprises don't usually make this kind of mistake. This is a typical big government project. Software development is hard. Building large, complex, poorly defined software systems is hard.
//EDIT
I should clarify that. I don't think a private enterprise would engage in a project that would have it build an internal system, at that scale ($100 million), having so little impact on it's primary revenue driver, over so many years!
Big enterprises fail with big software, that's a fact. But they wouldn't fail in this specific way. This is a quintessential big government software project failure.
Really? You sure about that? Because hard numbers are hard to come by, but I'm pretty sure they do with some frequency. It's notoriously common for large consultancies not working for the government to have the same outcome too.
It's possible private enterprise makes this mistake at a different rate than the government, but I'd despair of trying to prove that claim, or even give it a solid definition. In general large software initiatives seem to fail, regardless of whose bright idea they are.
For some reason the Economist article doesn't mention that the project was originally awarded to Siemens and Deloitte [2], but technical failures and cost overruns by these private companies caused the BBC to bring the project in-house. It could be argued that the BBC lacked the capability to deliver the project on its own, but thats also a mistake found in the private sector.
[1] http://www.computerworld.com/s/article/9116470/IT_s_biggest_...
[2] http://en.wikipedia.org/wiki/Digital_Media_Initiative#Initia...
As to private contractors doing a poor job when paid with taxpayer money - makes some sense, as long as said money keeps flowing. In a different setting the flow would stop more quickly.
I did one stint at a BigCo, during which they blew over $100M on a "platform of the future" project on which all their disparate software products were going to be developed going forward. It was obviously never going to work, yet they kept funding it and kept pushing it on all their software teams. Even though this was a massive failure, it was never announced as such or even explicitly canceled. It just crawled off to die alone somewhere. Official rhetoric was that the project had succeeded, and the executive who had championed it was promoted to run the entire software division of the company.
Edit: so I think the salient difference here is not private vs. public, but large vs. small.
The people at the top of a business software product might be stockholders, so they could have some risk. The people at the top of a government project also understand that it will be their photo in the media along with the public outrage. And both understand that the consequences - whether public anger or a dip in the stock price - are temporary and will go away in a few weeks.
How does that compare to the BBC's viewer & listenership numbers for $150M for a Audio/Video production system?
This is very common, I think perhaps the hacker news crowd probably have more experience with real software behemoths like google, facebook, microsoft and/or scrappy smaller start ups. Perhaps in those realms this doesnt occur because software delivery is their bottom line. In run of the mill fortune 500 companies major software projects fail commonly, and CRM and ERP projects fail even more frequently and have price tags in the 10s of millions, and when they fail the company has no choice but to roll out a new one
Levi-Strauss, SAP, and $100M: http://www.zdnet.com/blog/projectfailures/levi-strauss-sap-r...
"Levi’s is bucking the industry-wide trend by going ahead with ERP now. 'It’s expensive, high risk and requires a lot of cultural change, and unless you have a really compelling reason to do them you don’t [during a downturn],' says Paula Rosenblum, an AMR Research analyst."
Waste Management, SAP, and $100M: http://www.zdnet.com/blog/btl/promises-promises-a-look-at-wa...
Sorry, you are still wrong. The BBC is specifically in the business of video content and their failed system was a video content management system. You can not get any more core to a business than that! This is a quintessential big software project failure I do not see how it being in government has anything to do with it or how you have made any kind of case for that belief.
I would say "Actually large private enterprises don't usually [admit to making] this kind of mistake." I swear the ERP and document management are the two areas where every enterprise tries to "standardize across organizational units" and fails badly[1].
I have come to believe that this type of software is hard because it imposes rules foreign to the entity on it and doesn't value a companies existing workflow[2], or it requires thousands of developer hours to adapt.
1) oh, they keep using the new system, but their customers feel it
2) often a very successful workflow for the entity and its customers since the entity can now afford a multi-million dollar software package
Most large enterprises have workflows which could be vastly improved by automation of ANY kind, even one that is imposed by a minimally customized ERP. ERP implementations are most successful, on both an ROI front as well as success in implementation, when they are brought in and the existing workflow, at a high level, is redesigned to fit the tool. Why?
The other path is chaos, because you are essentially asking people whose jobs revolve around doing things manually to "build their own replacement." A simple way of putting it is getting the assembly-line workers to have input on a new, highly automated assemblyline. They don't want the robots to do their jobs for them. Instead they will all insist on the value of their interaction in the process, and the robots will simply be tasked with helping them do their job instead of simply replacing them.
When ERPs succeed, they lead to lots of admin people getting laid off or reassigned. These are the same people that have to be consulted if you want to customize them for a company's existing workflow. They fight tooth and nail to keep everything the same as it was.
My take now:
The workflows of large enterprises are not really well understood at all. With lean management and how management careers work, even the lowest management levels has only a vague idea what is actually happening in their departments.
Designing even a tiny system for a small number of users requires a lot of time and a lot of love. People do many more things that they could ever put into words. The new system breaks many things in ways that are difficult to describe. The users are defenseless because they are up against huge projects with a lot of momentum and are not prepared to communicate those kinds of problems.
Uhm, so let's hope that your ERPs are actually succeeding.
General Electric is a model of how to implement an ERP. They followed the minimal customization model, and forced their workers to change their workflows to take advantage of the tool. The key is to identify all of the data an org needs, and make it accessible. If your developers don't have an excellent metadata analysis/storage tool (homemade or bought) they are screwed.
I am sure that you must recognize, that when people complain about ERP implementations not fitting, they refer to implementations that you describe as "model"?
I come from the other end of the spectrum, making my first steps building business-process relevant tools while employed in various functions. What really shaped me was having carefully discussed the requirements, building it as specified, then being called because "it is not working", and realizing then and there what the actual business logic was, and how deep it was buried and how dysfunctional it all would have been had I insisted that I had implemented as specified.
I'd say (to the consultant profession in general), grab the proverbial pistol and flashlight (http://en.wikipedia.org/wiki/Tunnel_rat), and go down the rabbit hole, because that's the only way the job can be done right.
Yep, that's the model, but I contend it is a pretty poor model for everyone but the ERP vendor. It is basically saying the ERP or CRM vendor has a better grasp of a companies business process than the company. I have seen companies adopt a ERP and use its process, then anger customers because of the change. Since they follow a new path, many times it is IT telling the rest of the business how to run things[1] and much of the institutional knowledge is thrown out.
1) something as simple as what's on the invoice or payment voucher can have huge affects on customer experience in some industries.
Actually large private enterprises don't usually make this kind of mistake.
counter-anecdotes, 24.4k hitshttps://www.google.com/search?q=lawsuit+failed+erp+implement...
4M hits, but lots of dups:
https://www.google.com/search?q=lawsuit+failed+crm+implement...
Your last two points contradict your first two. There's nothing unique about a government's ability to make terrible decisions. I'd say one difference is that private enterprises typically go under if the mistake is big enough, and they have no great interest in telling the public about their mistakes.
I'm not saying private enterprises can't fail or don't fail. They just wouldn't fail in this specific way at that magnitude.
Isn't this a circular argument? If a company doesn't want to build a system in-house then its only other option is to contract another company to build it. At some point, someone has to build the system.
Are you new or something? Do you know how many projects I've been brought in to rescue? Do you know how many times my advice to "Stop throwing good money after bad" has been ignored for one reason or another?
Big enterprises fail in exactly this kind of way. All. The. Time.
http://www.insearchofstupidity.com/
I have this book, and I'm sure there are plenty more like it.
I have been at several mid to large sized private companies and have watched at least 4 $30mm+ projects go up in smoke over the years. Fortunately I have not been involved in any of them directly but I got a front row seat. Surprisingly more then half didn't result in extensive turnover of the key parties involved.
It seems to me that months or years of auditing and hearings and cries for heads to roll are probably wasted. Just like a private company a few mangers should probably get tossed or reassigned and the second version of the same project should get started to address the businesses needs the first one was supposed to.