News for hackers. Stuff that matters.
Re:Whatever happened to Six Sigma? by legitster on Wednesday September 04, 2019 @04:45PM (#20881238)
Like a lot of business methodologies, the principles are sound - but eventually they turn into cargo cults around a meta-process that only exists to feed itself.

The exact same thing is happening now with 'Agile' where big corporations are switching to sprints and hiring scrummasters, and renaming departments - mostly as a way to stay hip and cool. But at the end of the day, there is no business framework that will replace good judgement and discernment.

Re:Whatever happened to Six Sigma? by blfr on Wednesday September 04, 2019 @04:54PM (#20881308)
This is the managerialist dream. To replace employees' judgement and competence with a process and management methodology. That way everyone is just a replaceable cog in their beautiful machine.

It never works.

Re:Whatever happened to Six Sigma? by sgt101 on Thursday September 05, 2019 @03:29AM (#20884597)
this. I got into real trouble a few years ago by speaking my mind to my MD about the latest motivational posters which portrayed our business unit as a machine made of gears and cogs. I had two objections. One, people are not cogs. Two, the gearing system on the pictures wouldn't work. I got approbation because I was not "commercial enough" and also "not onboard" but the pictures stopped being made. So... a win.

The thing that strikes me is that engaged and experienced employees deal with rafts of problems silently, using their networks to create and co-ordinate responses without executive intervention. In fact executive intervention is actively avoided because there isn't enough time in the exec's diaries to communicate and debate the issues properly so inevitably such intervention will be via over simplified solutions that often make things worse. The problem with this is that execs do not see what is happening. If they did they would be impressed and pleased with what is going on, but uneasy about the risks and their irrelevance. What this then leads to are management culls where value is lost because the problems that are being solved are not acknowledged in the company before the cull. After the cull this all emerges as a huge and nasty surprise that the company now lacks the capability to deal with.

The lesson : not everything (in fact not much) about a business is on the balance sheet, and in the corporate world the dead have no voices.

Re:Whatever happened to Six Sigma? by bitwize on Thursday September 05, 2019 @10:56AM (#20887324)
> I got into real trouble a few years ago by speaking my mind to my MD about the latest motivational posters which portrayed our business unit as a machine made of gears and cogs.

"A company..."

"...is like an enormous clock."

"...is like an enormous cl-- yes, precisely!"

Re:Whatever happened to Six Sigma? by Accujack on Thursday September 05, 2019 @02:39PM (#20889564)
Re:Whatever happened to Six Sigma? by 1980phipsi on Thursday September 05, 2019 @07:08AM (#20885549)
approbation?
Re:Whatever happened to Six Sigma? by sgt101 on Thursday September 05, 2019 @07:29AM (#20885633)
I'm so sorry, I meant disapprobation, but because I am stupid I wrote the wrong thing.
Re:Whatever happened to Six Sigma? by steverb on Thursday September 05, 2019 @11:17AM (#20887571)
I had to look the root word up. So, you're still ahead of my game. :-)

Approbation: approval, or praise.

Re:Whatever happened to Six Sigma? by james_s_tayler on Wednesday September 04, 2019 @05:49PM (#20881775)
Well you could say it never works optimally, but it depends on what you are optimizing for. A lot of people think that because business need to make money that they should optimize for making the most amount of money and therefore try to maximize productivity. They look at organizations and what they see is very much at odds with that.

In reality they don't try to maximize employee productivity, they try to maximize employee fungibility.

If all the company is trying to do is survive then I'd say it definitely works.

Re:Whatever happened to Six Sigma? by sgt101 on Thursday September 05, 2019 @03:33AM (#20884611)
In the short term; the twin problems - things change (more so now than in the past) and much corporate activity is necessary but unacknowledged in the org chart and balance sheet. Ripping out "inefficiencies" leaves businesses without capability. Reacquiring corporate capabilities (or acquiring them) is a long and risky road. Business schools and investors need to think about diversity of capability and expertise and ability to respond and change as measures of long (even medium term) corporate value.
Re:Whatever happened to Six Sigma? by wwweston on Thursday September 05, 2019 @02:15PM (#20889371)
Two other considerations:

(1) what does it mean to optimize within limits of average managerial perception? while some management knows the domain well enough they can identify issues and talent that add additional levels of productivity... many can't. Or as some say, A players hire A players, B players hire C players, etc.

(2) predictable + control-able levels of productivity may well be more valuable in meeting managerial goals than exceptional levels of productivity. this is a generalization of the fungibility optimization; fungibility is one aspect of predictability and control.

Re:Whatever happened to Six Sigma? by james_s_tayler on Thursday September 05, 2019 @04:37PM (#20890441)
I liken it to an organism. An organism is trying to stay in homeostasis. It's also either growing or decaying, though it mostly appears static.

It's exactly as you say. Many aren't capable of identifying opportunities for optimization. Re: the organism metaphor - an organism can be relatively unhealthy and still survive. Some people are ultra-fit. Most are not. Some people really are quite unhealthy. The bar for survival is fairly low. Project that on to companies you can imagine the ultra fit being those companies whose managers can work together to identify opportunities for all the things they are aiming to optimize for and are able to optimize for more than just staying alive.

Re:Whatever happened to Six Sigma? by _glass on Thursday September 05, 2019 @05:25AM (#20885141)
so this would confirm system theory's point of view, that exactly states that just this can be the goal of a system, where companies are just an instance of precisely that.
Re:Whatever happened to Six Sigma? by dragonwriter on Thursday September 05, 2019 @03:14AM (#20884544)
> This is the managerialist dream. To replace employees' judgement and competence with a process and management methodology. That way everyone is just a replaceable cog in their beautiful machine.

It's ironic in the adoption of sold-as-Agile processes, since it is precisely the idea that Agile (as in the Manifesto and associated Principles) was a firm reaction against.

Re:Whatever happened to Six Sigma? by hrktb on Thursday September 05, 2019 @06:10AM (#20885304)
It's a kind of embrace/extend process:

- new ideas come to an enterprise

- they decide to apply it and see the "shortcomings"

- apply additional processes to where they feel it doesn't match

You end up with something not so far away from the original process, but slightly changed and more marketable. It can have noticeable good effects, but usually doesn't end up being any radical change or revolution.

Re:Whatever happened to Six Sigma? by Ididntdothis on Thursday September 05, 2019 @06:57AM (#20885495)
I think a lot of new ideas also get neutralized by modifying them in a way that the power position of the people on the top doesn’t get threatened. I have seen that now several times. Something like agile gets introduced. Management embraces it but after a while when management would need to change, the enthusiasm stops and no further changes happen.

It seems that management only responds to top-down change but not bottom-up.

Re:Whatever happened to Six Sigma? by tacostakohashi on Wednesday September 04, 2019 @05:00PM (#20881362)
What is it about software development that keeps on attracting these "methodologies"?

Why don't doctors or lawyers or commercial pilots have people coming along with a methodologies for doing their jobs?

I have a few ideas, but I still feel like there's more to it than I quite understand.

Re:Whatever happened to Six Sigma? by MegaButts on Wednesday September 04, 2019 @05:24PM (#20881579)
Pilots especially are heavily trained to use checklists for just about everything. A significant chunk of training to be a pilot is just reinforcing the behavior to always use the checklist.

Doctors, based on my limited understanding, are becoming more and more pragmatic about using checklists in surgeries. I am not a doctor, nor am I an expert, I have just read some interesting articles and heard from surgeons that they are trying to improve the process to reduce careless mistakes.

No clue about lawyers.

So processes can actually be incredibly useful, and oftentimes are designed after the fact. Agile has some neat ideas as well, but in practice I'd say 90% of the time it's pretty fucking terrible and the company would be better off without trying it entirely. Not because agile is bad, but because the people in charge of agile are usually bad.

At the end of the day it comes back to something I've learned painfully time and time again throughout my career. No matter how talented you are, you are powerless against a shitty manager.

Re:Whatever happened to Six Sigma? by tolien on Wednesday September 04, 2019 @06:03PM (#20881868)
> Pilots especially are heavily trained to use checklists for just about everything.

Yeah, but it didn't appear out of nowhere. NASA et al did a tonne of research [0, 1] that led up to the idea of using checklists. Likewise Cockpit/Crew Resource Management [2] and the psychology of getting people quickly out of aircraft that are on fire [3], all of which were prompted by one disaster or another.

Software engineering could use some of that rigour, but I'd anticipate a little resistance to publishing research which shows that the process of building some piece of software was a shitshow because the people running said show were bad at it.

0: https://ti.arc.nasa.gov/m/profile/adegani/Flight-Deck_Checkl...

1: https://ti.arc.nasa.gov/m/profile/adegani/Cockpit%20Checklis...

2: https://web.archive.org/web/20131026210937/http://yarchive.n...

3: Lots of which happened after British Airtours 28M, https://en.wikipedia.org/wiki/British_Airtours_Flight_28M and https://assets.publishing.service.gov.uk/media/5422efe840f0b...

Re:Whatever happened to Six Sigma? by davidw on Wednesday September 04, 2019 @06:48PM (#20882146)
As always: for most software, the consequences aren't that bad, so a company that was really rigorous and disciplined and as a consequence a bit slower might well be out-competed by a company that's run in a bit more 'fast and loose' way.
Re:Whatever happened to Six Sigma? by tolien on Wednesday September 04, 2019 @07:08PM (#20882282)
Yeah, I was going to say that - the difference between the rigorous research in aviation/medicine and most software projects can be measured in dead bodies.

There's plenty of software that really matters though, in the same way that using checklists and things makes sense in environments where you won't kill people. We could all learn something if someone researched using, for example, an Agile methodology for building the F-35's flight control software, for example!

Edit: Thinking about this some more, I suppose my point is how to measure this:

> a company that was really rigorous and disciplined and as a consequence a bit slower might well be out-competed by a company that's run in a bit more 'fast and loose' way

while correcting for other factors like marketing etc. You can measure how quickly a group of people will get off an aircraft and vary things like the dimensions of the exit row to test whether your change has improved things but you can't, e.g., re-run a project with TDD and test whether it was "better" (defining "better" in the first place is hard enough!)

Re:Whatever happened to Six Sigma? by rubyfan on Wednesday September 04, 2019 @07:38PM (#20882480)
For many financial services companies the consequences for bad software quality tend to be high, either from bad calculations at scale or downtime. It’s not life and death but in many companies the pain is real and one of the many reasons for non-agile highly planned and highly process oriented operations.
Re:Whatever happened to Six Sigma? by arvinsim on Thursday September 05, 2019 @04:25AM (#20884880)
Yup, I agree. If there was a heavy penalty on the business/financial level(not just on the software level), businesses would take things like software testing, proper timeline management and rigorous specifications more seriously.

Unfortunately, that's not the case. So most business just bulldoze their way to their primary objective.

Re:Whatever happened to Six Sigma? by reading-at-work on Wednesday September 04, 2019 @05:41PM (#20881711)
> Not because agile is bad, but because the people in charge of agile are usually bad.

That's the crux of it. Currently working at an org which is "Agile" and has Scrum masters, but management still insists on measuring work in man-hours and defining requirements in huge chunks then delivering them at arbitrary deadlines. So... it's waterfall with Scrum masters who make it look nice on Jira charts.

Re:Whatever happened to Six Sigma? by flukus on Wednesday September 04, 2019 @08:04PM (#20882638)
> I am not a doctor, nor am I an expert, I have just read some interesting articles and heard from surgeons that they are trying to improve the process to reduce careless mistakes.

Also not a doctor but I've built some checklist software for them. At good hospitals there's a nurse counting every screw, piece of gauze and scalpel passed around in surgery, counting them again on the way out, counting them when the go into the dishwasher and counting them again when they come out of the dishwasher and get preped for the next surgery. Apart from emergencies doctors will have a list of instruments needed for any given operation and there will be a special package of them ready.

This was heavily influence by the aviation industry.

Re:Whatever happened to Six Sigma? by goatinaboat on Thursday September 05, 2019 @05:11AM (#20885091)
Pilots especially are heavily trained to use checklists

But I bet there are no methodology merchants who never fly planes or operate aviation businesses selling expensive checklist consulting, wasting the time of busy pilots with actual work to do. Like who is the Thoughtworks of piloting? Or of surgery? They don’t exist. Only software is plagued with them.

Re:Whatever happened to Six Sigma? by heelix on Wednesday September 04, 2019 @06:38PM (#20882083)
Funny enough, the practical test standards are more or less published as the test checklist, which includes verification that the person getting their pilot's license used checklists proficiently. (The checklist checks checklist checks?)
Re:Whatever happened to Six Sigma? by sgt101 on Thursday September 05, 2019 @03:47AM (#20884680)
Checklists are fantastic if used in the moment by a team.

Checklists used post hoc and imposed on individuals are (IMHO) worse than useless - they give a sheen of process and quality by forcing someone to randomly ink boxes.

Re:Whatever happened to Six Sigma? by philpem on Thursday September 05, 2019 @03:58AM (#20884744)
And provide a big stick to whack the unfortunate employee.

"You ticked box AX-two-alpha-seven. Do you know what that means? And you didn't complete the P12a checklist. That's gross misconduct. You're fired."

Re:Whatever happened to Six Sigma? by sanderjd on Wednesday September 04, 2019 @09:05PM (#20882971)
I don't know much about Big Law, but I would be shocked if they don't have the same sort of thing. Hundreds of entry level folks with high turnover with a simple metric (billable hours) to track their progress; it sounds ripe for some equivalent to Agile.
Re:Whatever happened to Six Sigma? by pnw_hazor on Thursday September 05, 2019 @11:29AM (#20887683)
No such thing. Each partner runs their own show for their own clients.

Firm-wide common resources such as a docketing departments will have checklists but they are mostly software driven/automated these days. For example, creating a new matter in the docketing system will automatically generate most of the critical dates and checkoffs for that matter.

Re:Whatever happened to Six Sigma? by jwhitlark on Thursday September 05, 2019 @02:27AM (#20884333)
I have heard that big consulting firms generally have a system per firm.
Re:Whatever happened to Six Sigma? by dreamcompiler on Wednesday September 04, 2019 @05:51PM (#20881795)
It's because software development is always harder than you think it's going to be, takes longer than you think it's going to take, and results in more bugs than you think it should. So the temptation to seek simplistic magic bullets that "fix" software development is overwhelming.

A better idea would be to reexamine why we "think" software should be so much easier than it really is. Perhaps it's because when we watch it being done, it looks like typing.

Re:Whatever happened to Six Sigma? by nullspace on Wednesday September 04, 2019 @05:03PM (#20881395)
Can't speak for lawyers or commercial pilots, but doctors absolutely have "methodologies" or processes. And processes that each individual hospital dept sets up last for years.

They're usually different across depts and hospitals though.

Re:Whatever happened to Six Sigma? by tonyarkles on Wednesday September 04, 2019 @05:18PM (#20881533)
Oh man, our provincial health region recently went through a “Lean” transformation. Talking to people on the inside, it had some positive efficiencies come out of it, but it also resulted in some pretty terrible negative consequences. For example, medication shortages in rural areas, because they figured it would be better to send it to areas that needed it Just In Time. Except... some of those areas only get weekly deliveries, or worse.

Similar story with diagnostic medicine. Smaller laboratories shut down because they were redundant, and then lead times for blood work etc go up because of travel time. We used to have a provincial bus/courier system in place, but the govt shut that down because it was losing money, and the health care system suffered for it. Last I heard, rush samples between major centres are currently being shipped by 3-hour taxi cab rides.

Re:Whatever happened to Six Sigma? by AstralStorm on Thursday September 05, 2019 @06:36AM (#20885394)
Actual Lean as opposed to paper tiger version carefully verifies the effects and side effects of any change.

This rarely happens in "Lean" implementations in reality. What happens is "change and see" which is not what the process is about.

Re:Whatever happened to Six Sigma? by roenxi on Thursday September 05, 2019 @08:38AM (#20886011)
You get into a funny position because management philosophies, Lean included, are basically defined as "Do things that work, don't do things that don't work. Only spend money on things that add value".

So basically anything that spectacularly doesn't work is usually not 'actual' [insert method here]. Management failures are rarely obscure even in foresight.

Re:Whatever happened to Six Sigma? by gtycomb on Wednesday September 04, 2019 @05:50PM (#20881788)
> What is it about software development that keeps on attracting these "methodologies"?

Here is one data point for you from personal experience. A few months after got started at a US company operating in about 30 countries (primary business is manufacturing in the Casino and gaming industry) the word came from the CIO that I implement Six Sigma as part of the enterprise architecture activity that I headed. I countered that neither software engineers nor the IT architects and admins worked in the Six Sigma way and wondered at the meeting where this whole idea came from. I was told this was what the Chief Operating Officer and/or VP of Finance wanted to implement "across the company". Such things happen in this world we live in.

Re:Whatever happened to Six Sigma? by TheOtherHobbes on Thursday September 05, 2019 @04:44AM (#20884971)
Software is derived from the production line/engine room model. It's based almost entirely on metaphors that assume the things that matter happen in a sequence, and there are ways to make the sequence faster, more efficient, more reliable, and predictable.

So the same thing applies to software management. And also - in different ways - to management in general.

Law is derived from the competitive sport model. The sport is verbal rather than physical, but it's really a form of mental combat with the physical violence abstracted away.

So in practice it's a combination of business negotiation, corporate politics, national and international diplomacy, book research, a very specific kind of creative writing, acting, public speaking, and psychology of persuasion, with different emphases in different areas.

You could have a process for basic case management, and I would be surprised if practices didn't. But the sharp and pointy end - the part where all the elements are used to create a negotiated contract or a court performance - is very difficult to formalise.

Re:Whatever happened to Six Sigma? by booleandilemma on Wednesday September 04, 2019 @06:24PM (#20881993)
New industry + lots of money being thrown around = lots of attention and snake oil salespeople.

Software development is riddled with unscientific practices that are derived from some person’s blog somewhere.

100 years from now when they’ve found out the optimal way to do development we won’t have all these methodologies.

Re:Whatever happened to Six Sigma? by kakwa_ on Wednesday September 04, 2019 @07:04PM (#20882256)
Software is also a really immature field. Software development is not an industrial process, it's more like craftsmanship. Part of it comes from the fact the field is relatively young, but also because in software, it is extremely easy to modify to suit new needs and to fix introduced mistakes which results in an inherent instability of design and no strong patterns.

It's getting better, but it's still present.

For example, nearly each source tree I've seen has its own idiosyncrasies in term of organization and layout.

Are the tests in ./test/ or ./tests/? how do I run the tests? where do you put the headers? ./inc/? ./include? what are the options available at compile time? how are they exposed? what are the install targets? does it support the usual variables (looking at you DESTDIR)?

Granted more modern languages tend to be more normalized than the previous examples which are valid for C/C++ mainly. But these questions still applies. For example, the Go projects I've seen tend to vary wildly in term of compile tool chain, some have nothing, just run go build, other have a ./build.sh and the better ones have a basic Makefile which is generally not so great (no variable present to override the path to the go binary or set some compilation variables, no proper install target, very weird handling of the ./vendor/ directory in some cases).

Re:Whatever happened to Six Sigma? by rstuart4133 on Saturday September 07, 2019 @09:24PM (#20907941)
> Software is also a really immature field.

It's not that immature. I'd measure the maturity of engineering, or any field really, as it's ability to create reproducible results. That result could be designing bridges that last a predicable amount of time, cars that run for a certain number kilometers before wearing out, or surgery that produces the outcomes predicted. This doesn't mean the surgery always works, or there isn't the odd car that fails in it's first 1000km: just that we know what the rates outcomes are and we can keep below a given level for a known cost. That level is never 0 because the cost for 0 rises to infinity.

For software it's a case of delivering something that does the job asked for and that operates at below a certain failure rate. This doesn't mean a zero failure rate or no bugs: just that we set a upper limit and can reliably meet it. It seems pretty clear there are many large teams of software engineers out there that can do precisely that. Google has even allowed their engineers to write & publish books about how they achieve that: https://landing.google.com/sre/workbook/toc/ It's not rocket science - just a method of doing things team of sufficient size can replicate.

> For example, nearly each source tree I've seen has its own idiosyncrasies in term of organization and layout.

I've got some news: that happens in every engineering discipline, even the mature ones. There are some things that don't effect the outcome overly. What you name you directories may be one of them. It may be it so unimportant they leave it to an engineers discretion, or it may be an organisation can settle on any name, provided they stick to it.

> But these questions still applies.

No, it doesn't. If you look at that site reliability engineering handbook, it's not about naming directories. It's mostly about measuring failure rates, and then applying well known techniques if it is getting too high. The well known techniques are mostly about change control, which happens to be a very boring subject most young software engineers almost universally hate. Trying to impose change control on a young software engineer is like trying to put a lead on a cat: it will do anything to avoid it including pulling in the reverse direction to where the lead is going, playing dead and refusing to acknowledge it's possible to move at all with the lead on, and attacking the person trying to put it on.

Re:Whatever happened to Six Sigma? by 6thaccount2 on Thursday September 05, 2019 @06:58AM (#20885501)
Also, there are big differences in the paradigm used. Sure OO is dominant in enterprise software, but there is also functional programming and many others that have a big impact on organization.
Re:Whatever happened to Six Sigma? by blihp on Wednesday September 04, 2019 @06:43PM (#20882114)
The fact that software development is not something most organizations understand how to do (well/at all) but still insist on trying to do anyway. Unfortunately, this means that a significant percentage of their projects will fail. Changing out methodologies/tech stacks/languages are great way to redirect blame when things go wrong.
Re:Whatever happened to Six Sigma? by marcosdumay on Wednesday September 04, 2019 @06:38PM (#20882081)
Doctors are always on the news for resisting such imposed methodologies, the amount of them should be much larger than what is visible.

For pilots, I literally work in a pilots methodology factory :)

But if you want to see crazy methodologies, imposed by the ton, by people that have no idea what they are talking about, go look at teachers.

Re:Whatever happened to Six Sigma? by stone-monkey on Wednesday September 04, 2019 @05:14PM (#20881494)
aren't hospitals infamous for their broken processes? It doesn't seem to me like forcing doctors to work 24 hour shifts improves their judgement while on the job, or improves overall health outcomes, anyway.
Re:Whatever happened to Six Sigma? by blfr on Wednesday September 04, 2019 @06:15PM (#20881934)
Supposedly it does improve health outcomes because tiredness is less of a killer than patient handoffs between doctors.
Re:Whatever happened to Six Sigma? by dragonwriter on Thursday September 05, 2019 @03:31AM (#20884605)
> What is it about software development that keeps on attracting these "methodologies"?

Nothing. Management theories exist around managing every specific kind of work, as well as generic theories. Software development, HR, and other kinds of work that are done in (or contracted for by) almost every organization of non-trivial size probably get a bit more because more people are managing them. Many of the theories in software development are direct adaptations of process theories from other disciplines. Waterfall —before it was named—was just application of practices from non-software engineering, Lean is from manufacturing, kanban is a specific practice from the manufacturing organization whose processes inspired Lean, etc.

“Agile” started in software but it's everywhere.

> Why don't doctors or lawyers or commercial pilots have people coming along with a methodologies for doing their jobs?

They do. They are even often the same methodologies seen in software: e.g., in healthcare: https://www.healthcatalyst.com/insights/healthcare-project-m....

Note that the theories around software are often the theories of process improvement rather than the daily work in other domains (interestingly, this is not true or kanban), because software is just automated process so software development is essentially the exact same task as process development/improvement, where some portion of the process is executed on a computer.

Re:Whatever happened to Six Sigma? by DanBC on Thursday September 05, 2019 @02:47AM (#20884424)
> Why don't doctors [...] have people coming along with a methodologies for doing their jobs?

They do. You're not involved in healthcare so you don't read healthcare specific websites.

Here's some stuff aimed at the English NHS, but there is lots more.

http://horizonsnhs.com/

https://fabnhsstuff.net/

https://q.health.org.uk/about/

This tends to be the NHS learning about something and implementing it themselves, rather than hiring a management consultant. That's because they want to protect public money and there has been a lot of bad experience of management consultants for this kind of work in NHS organisations.

Re:Whatever happened to Six Sigma? by AmericanChopper on Wednesday September 04, 2019 @05:35PM (#20881661)
Software development is an incredibly immature professional discipline, which has lead to people mostly making it up as they go. You also have the rate at which it changes, making it hard for any sort of standard practices to keep up with. Outside of some industries that regulate security and privacy, software development has also never attracted the attention of any regulator that may have an interest in actual quality of workmanship (which would be impossible in any case). Can you imagine the architecture equivalent of shipping terrible code? “This software has bugs” is acceptable, “this brand new building is falling down” isn’t. There’s a standard way to build a house, there’s a standard way to perform heart surgery, there’s nothing close to a standard way to build software, and if you can’t properly plan your work, how can you properly manage it?

That seems to be the problem these management fads are trying, and failing, to solve. People hated waterfall because you have to do so much planning up front, and in software development, that process rarely works. Project requirements change, or planning assumptions are proven wrong. So you need a management framework that works without that level of planning. That’s the core of agile in my opinion, only plan a little bit of work at a time. Really I think it just leaves you with the same problems, only now you have a lot of small failures rather than fewer large failures. If you look at the agile shops that succeed, they tend to have good leadership that simply has the competency to plan ahead well. Those teams would likely succeed under any management framework, only with agile you now also have the benefits of continuous delivery.

Re:Whatever happened to Six Sigma? by cameldrv on Wednesday September 04, 2019 @05:04PM (#20881400)
Commercial Pilots have Crew Resource Management.
Re:Whatever happened to Six Sigma? by keithnz on Wednesday September 04, 2019 @05:19PM (#20881537)
having done software for scheduling air crew onto planes, one of the biggest factors for them are the various aviation authorities rules / airport certifications etc. That shapes a lot of their lives, but airlines do have their own methods for trying to get the "best" out of their staff.
Re:Whatever happened to Six Sigma? by phkahler on Wednesday September 04, 2019 @05:10PM (#20881453)
Not to mention checklists for all sorts of things.
Re:Whatever happened to Six Sigma? by ekianjo on Wednesday September 04, 2019 @05:41PM (#20881710)
Checklists are actually a very good thing in aviation. You don't want to have huge variability between what each pilot should be doing.
Re:Whatever happened to Six Sigma? by phkahler on Friday September 06, 2019 @01:53PM (#20897950)
I agree. I use them. They're like a formal procedure.
Re:Whatever happened to Six Sigma? by blaser-waffle on Thursday September 05, 2019 @12:42PM (#20888428)
Methodologies are attractive for situations that are ambiguous.

Lawyers and pilots have a clear cut set of procedures. Pilots aren't inventing new technologies each time they fly, they're just driving the bus from City A to City B and worrying about occasional edge cases. Lawyers follow legal procedures and have their own built-in rules and processes; they're tested on these processes to pass the bar.

You see methodologies for things that vary wildly like sales, military leadership, and of course, engineering tasks. Each project, situation, or client could be extremely different, and it's not possible to build a prescriptive how-to for each scenario. So you create a methodology and framework so that managers and leaders can quantify uncertain situations and build (and alter) their own how-to's.

Re:Whatever happened to Six Sigma? by pnw_hazor on Thursday September 05, 2019 @11:24AM (#20887636)
Doctors, lawyers, and commercial pilots are licensed professionals.

Doctors and lawyers are personally liable for their screw-ups. I don't know how liability works with pilots but they will lose their license if they screw up.

By operating within the medical standard of care, doctors diminish malpractice liability. So having well-defined systems that help prove that you follow the medical standard of care is important.

Lawyers don't have anything like that as a whole. Each lawyer handles their clients their own way. Even in the same firm different partners will have different practices. Some use checklists for their staff to confirm that the certain required forms have been filled out or provided.

In the actual work of lawyering, checklists are not a thing I have seen. Though there are "outline" documents to help with bigger projects.

Re:Whatever happened to Six Sigma? by micmil on Wednesday September 04, 2019 @07:40PM (#20882493)
They all have methodologies. The pilot's checklist that was already mentioned is just one. For doctors you have different paths of treatment that can be standardized for years, then undergo major changes when new information is discovered. With lawyers it depends on what they do. New approaches to cases, new discovery methods, everything is a process and everything can be improved.

Software development attracts these things because software development isn't as firmly entrenched in tradition as doctors or lawyers are. There are way more people that are open to implementing ways of accomplishing tasks that are more open and efficient than there ever could be in most other realms.

Re:Whatever happened to Six Sigma? by blackflame7000 on Wednesday September 04, 2019 @05:09PM (#20881446)
Because that's exactly what software engineering is, coming up with "methodologies" aka algorithms to perform a task more efficiently.
Re:Whatever happened to Six Sigma? by sagebird on Wednesday September 04, 2019 @06:30PM (#20882041)
As the demand for computer automation increased, the market produced tools that less intelligent people could use, like Visual Basic vs C++. Management fads infect the dummies. How many lisp nerds do you see at an agile circle jerk meetup? Lawyers and doctors still have an intelligence test in the form of admissions criteria to universities, programmers don’t.
Re:Whatever happened to Six Sigma? by thanatropism on Thursday September 05, 2019 @08:12AM (#20885847)
> Lawyers and doctors still have an intelligence test in the form of admissions criteria to universities, programmers don’t.

This is both incredibly rude and pretty much irrefutably true.

As a startup cofounder I've had the experience to hire like 3.5 programmers to do front-end work in the past year. I'm not at a specially "hot" location for developers, but my n=3.5 anecdata is that the few intelligent programmers you can find have terrible work ethics and continually try to spend more time with what they find interesting and avoid drudgery work. The hoi polloi (who might have made damn fine designers, copywriters, etc.) rely on stack overflow for whatever they can, and dither on the slightly more challenging tasks they didn't know existed.

Besides filtering on IQ, one thing a nerdy education teaches you is that challenging problems are often solvable if you will just [wo]man up and try.

Re:Whatever happened to Six Sigma? by philpem on Thursday September 05, 2019 @03:57AM (#20884738)
It's not just software -- manufacturing sees a new "methodology" every other year.

Sometimes two or three in one year.

Re:Whatever happened to Six Sigma? by mmatants on Wednesday September 04, 2019 @06:09PM (#20881906)
Law as an industry is pretty dysfunctional. Plenty of data governance issues, losing track of documents, etc. A lot is at stake there, for sure, but that's actually the thing that process helps with - reliability and safety. And law is very resistant to incorporating that.
Re:Whatever happened to Six Sigma? by bonoboTP on Thursday September 05, 2019 @08:22PM (#20891896)
Lawyers feed on complexity and obscurity. If things made sense and the processes were logical and simple and easy to navigate, nobody would need their services.
Re:Whatever happened to Six Sigma? by praptak on Wednesday September 04, 2019 @07:29PM (#20882416)
'What is it about software development that keeps on attracting these "methodologies"?'

An unbelievably high level of interdependence between worker teams caused by the complexity of the product.

This produces chaos, the methodologies promise to tame it.

Re:Whatever happened to Six Sigma? by pkaye on Wednesday September 04, 2019 @05:42PM (#20881726)
Doctors, lawyers and pilots are in highly regulated industries so not just anyone can come in with their new methodologies.
Re:Whatever happened to Six Sigma? by Ididntdothis on Thursday September 05, 2019 @07:06AM (#20885534)
They are also not asked to be innovative. If the software industry decided to stick to one stack for the next few decades we would also get much better methodology and maturity. Instead we have this constant churn of new stuff where we never learn how to use our tools properly.
Re:Whatever happened to Six Sigma? by sixtypoundhound on Wednesday September 04, 2019 @07:28PM (#20882413)
Hmm... actually, process and outright automation (the apotheosis of process) work brilliantly for certain types of work.

Got something boring and repeatable? Process / Automate the daylights out of it. You'll be better off.

Anything that requires innovative thinking or customer focus? Requires fitting square pegs in round holes? Probably isn't going to go so well...

Speaking as someone who spends more time trying to manage the former (boring + repeatable), independent humans are generally the key point of failure in any process.

Re:Whatever happened to Six Sigma? by RestlessMind on Thursday September 05, 2019 @10:26AM (#20886948)
> a process and management methodology

After being a manager, I'd say that is not a wrong goal. If your team's success depends on individual heroes, then it is a fragile setup. People can be absent for a lot of reasons - changing jobs, parental leaves, disabilities, ... A good manager should put in place appropriate processes such that even if someone leaves the team, the show goes on smoothly for everyone else.

Re:Whatever happened to Six Sigma? by redleader9345 on Thursday September 05, 2019 @10:44AM (#20887179)
Manager of what? Some things require skill, some things don't. Low skill trades can be transformed into paint-by-numbers processes. High skill trades cannot be so easily encoded into a process.
Re:Whatever happened to Six Sigma? by Aloha on Wednesday September 04, 2019 @06:34PM (#20882063)
It works great... until you have an issue the process was never designed to handle, then everything just explodes.
Re:Whatever happened to Six Sigma? by KON_Air on Wednesday September 04, 2019 @06:52PM (#20882164)
If thing explode and you can't do anything about it then you are clearly in a cargo cult, not under a management that understood the underlaying philosophy; it is a glorified flow chart and you have to come up with your own practices for each step unique to your own process(es).
Re:Whatever happened to Six Sigma? by lacampbell on Wednesday September 04, 2019 @05:44PM (#20881735)
It seems to me that if you're an IC in a large team, you are a fairly replaceable cog.

Of course a large percentage of the cogs of any machine fly off at the same time, you're in trouble. But I don't think one IC matters much in any large organisation.

Re:Whatever happened to Six Sigma? by bitL on Wednesday September 04, 2019 @04:59PM (#20881358)
One could argue that mathematicians tried the same since Bourbaki? A set of mechanical rules in logic to describe everything...
Re:Whatever happened to Six Sigma? by growlist on Thursday September 05, 2019 @07:34AM (#20885655)
Not least because the environment is constantly evolving so as to make the One True Methodology™ redundant.
Re:Whatever happened to Six Sigma? by crispyambulance on Wednesday September 04, 2019 @07:35PM (#20882460)
There's some really sound ideas in six-sigma as well as the other practices that evolved from manufacturing like Lean, Kanban, TQM, etc.

These approaches work, for real.

The problems start when they become excessively dogmatic, or as some say cargo-cultish. These systems are intended to help people solve problems in an orderly way, they're not a replacement for common-sense judgement, and original thinking (which, <gasp>, is STILL NEEDED).

Sadly, the personality types that tend to go into supply-chain and manufacturing (and that's where I happen to work) tend to be frequented by rigid-thinkers who crave process and prescriptive "checklist" approaches. Whatever new thing these people take up, it's eventually ends up as a turgid mess of dogma.

Re:Whatever happened to Six Sigma? by colechristensen on Wednesday September 04, 2019 @04:59PM (#20881353)
The cargo cult happens at small startups too.

>meta-process that only exists to feed itself

I like to think of it like an evolving idea passing through people. The methodologies evolve to take advantage of certain human characteristics which aren't always positive and often revolve around controlling others and perfectionist order. People get sucked in by the enticing promise of better but only if we change the process here and here which leads to an enormous amount of time talking about how you're going to talk about how you're going to do your work.

Re:Whatever happened to Six Sigma? by ahsteele on Wednesday September 04, 2019 @04:53PM (#20881305)
Your thoughts on agile development are spot on. Eventually "agile" will become a bad word snickered at the same way waterfall is.
Re:Whatever happened to Six Sigma? by colechristensen on Wednesday September 04, 2019 @05:02PM (#20881385)
At least "waterfall" never existed, it was invented by people to describe something somebody else was doing.

The design-build-test cycle necessary for physical products where the build and test phases can take days, weeks, or years was being used for software where build/test can take seconds or at most hours -- faster design cycles are beneficial and lots of folks used to engineering things got stuck with really long cycles. You don't need a management framework to accomplish those faster cycles.

Re:Whatever happened to Six Sigma? by paulmd on Wednesday September 04, 2019 @05:26PM (#20881596)
In most cases what you need is management permission to move quicker. Everyone says they want to be agile, but doesn't want to invest in the tooling (unit and integration tests, build servers, etc) that would let you be agile, so you end up with agile overlaid over the waterfall methodology, which does absolutely nothing.
Re:Whatever happened to Six Sigma? by bmj on Wednesday September 04, 2019 @07:51PM (#20882560)
I would argue that management often doesn't truly understand "Agile" beyond "software engineers should operate this way." In my organization, the engineers are willing to be disciplined with Agile practices, but product management has no interest in real planning that would achieve a manageable backlog across releases. Instead, they change release scope numerous times, and nearly every release cycle runs long because we never finish what we start--by the final iteration we are working on entirely different stories than what we groomed in iteration #1. To them, "agile" means "do what we want whenever we want it."
Re:Whatever happened to Six Sigma? by shandor on Thursday September 05, 2019 @09:03AM (#20886224)
> "do what we want whenever we want it."

Isn't that quite well in accordance of Agile Manifesto's "Responding to change over following a plan"?

Sprints and backlogs and grooming, all those sound they're straight from the Scrum Book. And while I understand that for many Scrum == Agile, actually it's not.

Note that I'm not saying anything about what's the best way to do software. Only that "responding to change" sounds very much agile.

Re:Whatever happened to Six Sigma? by projektfu on Thursday September 05, 2019 @12:56PM (#20888575)
This sort of thing happens all the time. The Japanese-style quality movement had many different fads (for example 5S) but most of the top denizens said that there are some basic universal facts about quality but every organization has to develop their own system that works. Consultants can help you do that but you can't follow a textbook and make a company. By contrast, the American quality movement has always been filled with charlatans and fads like "Zero Defects". Do Americans want religion and not mastery? Who knows.

I see Scrum a lot like I see Six Sigma. They take some of the processes you see from a successful team and they turn them into gospel for managing all teams. Sometimes they try to apply these processes to the rest of the company in places where they don't make sense. They create a bunch of certification levels so that they can claim you can't just learn it from a book. They make a bunch of money but leave their clients in a strange place.

Re:Whatever happened to Six Sigma? by ahi on Wednesday September 04, 2019 @06:28PM (#20882025)
That's my organization. Most of the actual work doesn't go through either process because the engineers know if they start discussing things in the sprint planning a manager will pick it up for a multi-year "investigation".
Re:Whatever happened to Six Sigma? by derekp7 on Wednesday September 04, 2019 @05:41PM (#20881712)
Fortunately with cloud and open source tooling, there isn't anything to buy. And management is already excited about cloud because they read it in CIO magazine and their buddies mention it on the golf course.

The only thing needed is training on proper usage of the tooling. But that can come about organically when companies accidently hire a few competent engineers.

Re:Whatever happened to Six Sigma? by chrisseaton on Wednesday September 04, 2019 @10:18PM (#20883320)
> At least "waterfall" never existed

The waterfall paper criticised a process that did exist and still does exist in some companies - it didn’t make it up.

Re:Whatever happened to Six Sigma? by coldcode on Thursday September 05, 2019 @07:55AM (#20885763)
But people dragged the diagram out of the paper to create the idea that waterfall was a good thing. Boyce actually made fun of the idea.
Re:Whatever happened to Six Sigma? by chrisseaton on Thursday September 05, 2019 @07:59AM (#20885783)
Yes I know - but the point is it did exist. What were they naming and making fun of if it didn't even exist?
Re:Whatever happened to Six Sigma? by falcongod082 on Wednesday September 04, 2019 @07:25PM (#20882384)
That's what happens to everything that management gets their hands on. Agile is slightly different though, it was corrupted as a concept and commodified long before the big guys decided to embrace it.
Re:Whatever happened to Six Sigma? by bitwize on Thursday September 05, 2019 @12:58PM (#20888608)
I was frustrated at work about whether our "Agile" practices were really agile, and then the Rick Sanchez voice in my head spoke up: "Look, Morty, nobburpody gives a shit how 'agile' you are, or whether 'stories' actually meet the qualification for user stories, or whatever other horseshit you can think of. No one gives a shit about quality, either. All that really matters is that you make the ink on the bottom line black and make your boss look good. You could literally be shoveling out buggy shit with waterfall and no one will complain as long as you meet those criteria. Don't like it? Tough titty, motherfucker! Welcome to wage slavery! Now swallow your food pellet and get back to work, those giant capstans aren't going to turn themselves."
Re:Whatever happened to Six Sigma? by hindsightbias on Wednesday September 04, 2019 @05:40PM (#20881699)
My assumption today is that every Wharton, Haas and Harvard MBA comes with at least one semester of “Microservices will solve all your IT problems”
Re:Whatever happened to Six Sigma? by falcongod082 on Wednesday September 04, 2019 @07:26PM (#20882395)
They are almost right, Microservices absolutely bring all of your IT problems to front and center.
Re:Whatever happened to Six Sigma? by ubermonkey on Thursday September 05, 2019 @09:35AM (#20886501)
This is interesting to me, because I work in a "methodology" business -- except in our field, everyone understands that properly implementing Earned Value Analysis requires the combination of:

- Good people, who know what they're doing; - Good processes, that support those people; - Good tools, which enable the processes

There's been no effort (of which I'm aware, anyway) to turn this into a cargo cult. EVMS complex, and takes a lot of work to implement, but it has real & demonstrable benefits on large-scale projects. So it gets to stay a "real" thing and avoid the weird cargo-cult transformation that's plagued other ideas.

Re:Whatever happened to Six Sigma? by trentnix on Wednesday September 04, 2019 @07:14PM (#20882317)
good judgement and discernment

Otherwise known as leadership.

Certifications and systems and methodologies can make good leaders better, but I can't say I've seen an example where they've turned a non-leader into a leader.

Re:Whatever happened to Six Sigma? by falcongod082 on Wednesday September 04, 2019 @07:22PM (#20882365)
Maybe an example of good leadership, but not an example of leadership. You don't need to earn leadership these days, you can purchase it or be born into it, especially at a large corporation.
Re:Whatever happened to Six Sigma? by PopeDotNinja on Thursday September 05, 2019 @01:51AM (#20884184)
As a mentor once told me --there's no protection from being a moron.
Re:Whatever happened to Six Sigma? by jedberg on Wednesday September 04, 2019 @06:03PM (#20881861)
> The exact same thing is happening now with 'Agile'

I'd say that it started happening about 10 years ago. Even then companies were hiring for scrum masters and all that other crap.

Re:Whatever happened to Six Sigma? by soapboxrocket on Thursday September 05, 2019 @11:28AM (#20887676)
The goal is to make sure you are gone before the title roll back around to the original titles. I worked in a aerospace firm and the took all the R&T (Research and technology because development was done by production) titles and changed every single one with innovation. Then about 8 years later, they rolled all of them back, killed all innovation titles and put R&T back into the titles. Net result, not much as most of the same people were in the same positions.
Re:Whatever happened to Six Sigma? by Retric on Wednesday September 04, 2019 @05:01PM (#20881372)
Some processes also end up becoming the new norm.

A few professional certifications went from being fads to mandated by law.

Re:Whatever happened to Six Sigma? by Accujack on Thursday September 05, 2019 @02:46PM (#20889622)
"professional engineer"
Re:Whatever happened to Six Sigma? by omarhaneef on Wednesday September 04, 2019 @05:59PM (#20881836)
Our sigmas go to 7!
Re:Whatever happened to Six Sigma? by zhte415 on Thursday September 05, 2019 @07:56AM (#20885769)
And where do your sigma shifts go? 1.75?
Re:Whatever happened to Six Sigma? by mo1ok on Friday September 06, 2019 @05:42PM (#20900185)
A mantra sort of appeared in my mind watching agile fall apart and fail at a large fortune 50 company - "there is no replacement for leadership."
Re:Whatever happened to Six Sigma? by JustSomeNobody on Thursday September 05, 2019 @08:41AM (#20886034)
Where I work, we are rigidly agile because the policies surrounding it are so strict there's no room to actually be ... agile.
Re:Whatever happened to Six Sigma? by falcongod082 on Wednesday September 04, 2019 @07:17PM (#20882333)
You're not abstracting far enough, "business" is the cargo cult. All the derivatives are simply expected.
[dead]
Re:Whatever happened to Six Sigma? by hamilyon2 on Thursday September 05, 2019 @05:40AM (#20885197)
Actually it amazes me how many highly intelligent people do not realize benefit of visualization every little detail of work being done (because planning is hard), checklists (because people forget), communication and shared vocabulary (because projects can be huge and involve a lot of people).

Not to mention control of execution, because projects are late one day at a time.