But as soon as you're trying to do something unique or one-off or under-specified, bureaucracy impedes more than it helps. Which is probably why large bureaucratic organizations often get out-innovated by small organizations with far less resources at their disposal.
Bureaucracy is a solution to a coordination problem that I would argue doesn't really exist anymore. Software is, in one sense, bureaucracy codified in mechanical form. It replaces and obsoletes human bureaucracy. The classic bureaucrat essentially applies a rulebook to his input information and passes output information to someone else. He is a human computer.
Even the evolution of war leaves open the question whether bureaucracy is an asset or a liability going forward. War is getting faster and more targeted.
A computer on the other hand is utterly intractable. I'm not sure how that would help with unique, one off or under-specified problems.
If you want your bureaucracy to be more adaptable, I'd argue you need to give it more flexibility not less.
I'm sure several people on here would disagree with that, as there are plenty of people good at "convincing" computers to do things they shouldn't be doing, or to do things that their owners don't want them to. You just have to be more of a black hat, less of a schmmoozer....
I'd argue that even a hacked system is intractable though, as it still rigidly follows the rules no matter the outcome. That's usually what black hats are exploiting in the first place.
If the problem with bureaucracy is rigidity, then replacing human agency with computed agency would only exacerbate that in my opinion.
A (governmental) bureau is responsible for a delegated area of licensing (pre-emptive control), regulatory oversight (ongoing control), and "criminal" investigation (retributive action for violation), as granted by its enabling authority.
Bureaucracy is the discipline/science/art of managing a bureau, which isn't producing competitive market-action revenue (profits), so can only control efficiency by containing costs, which itself is an action that doesn't produce market revenue.
Oversight of a bureau (ascendant bureaucracy) exists solely to make sure some metric of cost containment and compliance with enabling authority is maintained within each bureau itself.
In short, bureaucracy is the regulatory management of regulatory management.
The omni-present danger in bureaucratic management is that the mechanisms to maintain and manage the bureaucracy are themselves non-profit seeking, and tend to motivate growth in the bureaucracy. In private enterprises (barring regulatory compliance requirements), the overall cost of its bureaucratic functions impedes its profitability, and should tend to limit the size of the "cost center" budgets to maintain market profitability (or a failed enterprise).
For government functions, the overall cost of the bureaucracy can only be paid for by tax receipts and public debt (and license and fines, which as the Chief Justic pointed out are effectively tax receipts). If there is no political will to constrain one of both of those, the bureaucracy will grow unbounded.
Anyway, the short of it has nothing to do with marshaling resources, it has to do with constraining costs absent profit.
You couldn't be more wrong about this. The decentralized Vietnamese beat the (by-then) bureaucratic US.
The US army during WWII was defined by its ability to delegate to the lowest possible level of the officer hierarchy and this was one of the major reasons it was able to beat the rigid and highly-centralized Nazis.
The Confederacy came within a stones throw of winning the Civil War, which would have been the equivalent of two guys in their garage taking down one of the worlds largest Corporations. They lost because of the overwhelming differences in resources, but their agility and ability to promote talent allowed them to run circles around the North for the first two years.
Winfield Scott and Hernando Cortes both won in Mexico because they distanced themselves from their respective governments. They were allowed complete freedom from bureaucracy because they went out of communication range of the politicians.
Sun Tzu actually made a name for himself by beating a major neighboring kingdom with a tiny, but agile force.
I could keep going...
Just to be clear: I am not arguing against agility and I think that the central agile ability -- the ability to fail cheaply -- is probably the most important feature in many areas, including some military conquests. (One of the most interesting applications of cheap failure is interface design. If you can test a new idea cheaply it allows feedback loops which make you feel like you're really "interacting with something.")
In any case, you've given me some food for thought, and thanks for that.
Put this into perspective, once the US finished paying interest on debt, medicare and welfare there's no money left over for anything else.
Science programs are one thing, but the government can't deliver 70 year old services with reasonable efficiency.
Most federal welfare programs, however, involve cutting a check. Look at the Social Security Administration. It has a budget of about $12.7 billion, and administers $700-800 billion in benefits to 50-60 million people: http://www.ssa.gov/pressoffice/basicfact.htm
That amounts to an overhead of 1.6%, or ~$250 per person served.
Or, look at it another way. Total federal payroll is about $180 billion, for 2.15 million federal employees (a number that has fluctuated between 1.8 and 2.2 million for the last half century despite nearly a doubling of the population). That's about 4.7% of the budget, or 1.2% of GDP.
Most of the federal government is not overhead. 95% of it is just taking in tax revenue from certain people and cutting checks to other people.
If you're less of a manager and more of a programmer then it's actually really nice to think about how we might use this to architect software and/or to collect nodes together. Capitalism might have an analogue for example in developing the same software multiple times, and taking the simplest and most elegant result.