News for hackers. Stuff that matters.
Re:Delphi Method by slindsey on Saturday March 06, 2021 @11:00AM (#26368255)
A company I was at 20 years ago did a variation of this for software estimation. It resulted in some good discussions. It wasn't anonymous as mentioned here.

When one person on the team says an element will take one week and another says 8 weeks, there are fundamental differences in assumptions that need to be worked out. That was the good part of the process. The bad was when the Project Manager doesn't let the process play out and simply takes the shortest of the available estimates.

Re:Delphi Method by faichai on Saturday March 06, 2021 @11:26AM (#26368440)
This triggered my PTSD with regards to project managers. People whine about agile and scrum etc. but what they don’t realise is that the biggest benefit of those processes was that they replaced project management led, waterfall based processes.

Waterfall failed for many reasons, but one of them was because you’d get asshole project managers constantly taking minimal estimates exactly as you describe and then applying pressure on individual devs when they overrun the minimum estimates.

One of the biggest contributors to developer happiness and productivity over the last 20 years has been to escape this tyranny.

Re:Delphi Method by specialist on Saturday March 06, 2021 @12:14PM (#26368837)
Professional project management (PMI) embraces critical path, iron triangle, risk management. Iteration was always The Correct Answer™.

Kids today conflate "throw it over the wall" with waterfall.

Agile rejects planning, foresight, vision, end goals. Agile was explicitly concocted to manage upwards, in those organizations unable or unwilling to do proper planning. Unfortunately, the originators wrote down their survival tips, which were then misunderstood by noobs and embraced by profiteers. Just like every other religious text.

Agile is not the victory of iteration over some imagined dark ages of project chaos. The Agile Methodology is to argue about the Agile Methodology. The cult(ural) spread of Agile is no different than any other vacuous self-help omni-fix content-free dogma.

Re:Delphi Method by Jtsummers on Saturday March 06, 2021 @12:40PM (#26369044)
Agile does not reject those things. That’s just a nonsensical statement at best and a straw man at worst.
Re:Delphi Method by monstersinF on Saturday March 06, 2021 @02:35PM (#26369865)
Nothing in this discussion seems to even mention the most important part of agile: talking to customers often
Re:Delphi Method by specialist on Saturday March 06, 2021 @01:42PM (#26369492)
Absolutely!

That's the genius of the Agile Methodology. Per the Zeroth Law of True Agility [0], we're both utterly correct. With no contradiction.

[0] The Agile Methodology is to argue about the Agile Methodology.

Re:Delphi Method by projektfu on Saturday March 06, 2021 @12:23PM (#26368904)
The obvious response is that PMI is a cargo cult. I mean if we're straw-manning everything.
Re:Delphi Method by specialist on Saturday March 06, 2021 @12:35PM (#26369005)
The more interesting question is: Why did Agile beat PMI?

Because project management is not a critical success factor.

Most projects are late, buggy, or outright failures.

One response was to improve project management. That worked okay. But like with most knowledge work, requires some effort.

Another response was to accept the failure rate and simply throw more resources at the problem.

aka Worse is better.

Re:Delphi Method by varjag on Saturday March 06, 2021 @03:46PM (#26370402)
Worse is Better is something else altogether.
Re:Delphi Method by legulere on Saturday March 06, 2021 @01:24PM (#26369358)
But wasn't waterfall always a description of what not to do?

https://en.wikipedia.org/wiki/Waterfall_model#History

Re:Delphi Method by Jtsummers on Saturday March 06, 2021 @01:33PM (#26369422)
It was supposed to be. Then some brilliant folks at the US DOD wrote it into some documents on how to manage large scale software projects.
Re:Delphi Method by cosmodisk on Saturday March 06, 2021 @12:33PM (#26368977)
Any decent project manager know their people,so if Mark says it will take 2 days but in reality takes 5, the PM should see these patterns and either help the person to improve estimations,or adjust project deliverables based on this knowledge.
Re:Delphi Method by wwweston on Saturday March 06, 2021 @02:12PM (#26369686)
That's true if the project manager's personal and organizational incentives are to make estimates that are as accurate as possible.

For some people and organizations, the purpose of estimates is not primarily informational.

Re:Delphi Method by NotPavlovsDog on Saturday March 06, 2021 @04:16PM (#26370584)
It's one of the many tools in the efficient tyrannical manager's toolbox, with a motto of "my goal is not to have you do effective work, my aim is to advance my goals and keep everyone below as a non-threat to those goals". Keep em busy and insecure.

Sure nice it doesn't work on competent developers, not with the current job market.

Re:Delphi Method by deckard1 on Saturday March 06, 2021 @01:58PM (#26369600)
> One of the biggest contributors to developer happiness and productivity over the last 20 years has been to escape this tyranny.

We've only replaced the tyranny of deadline crunch with the tyranny of daily micromanagement. You can't even wipe your own ass without so much as a Jira ticket and half a dozen people signing off on it.

And despite all of the rigmarole and rituals, you still have deadlines. Doesn't matter what the Jira board says. If some upper management dickweasel wants their feature, they will get it. Forget the story points and estimates.

Re:Delphi Method by clon on Saturday March 06, 2021 @12:34PM (#26368988)
You should look up "Conjoined Triangles of Success". It might do something to heal that PTSD.
Re:Delphi Method by leetrout on Saturday March 06, 2021 @11:03AM (#26368281)
Sounds like an unstructured planning poker?
Re:Delphi Method by andrewem on Saturday March 06, 2021 @01:06PM (#26369218)
It’s wideband Delphi, which predates planning poker by several decades.

https://en.m.wikipedia.org/wiki/Wideband_delphi

Edit: as I recall from doing estimating using wideband Delphi circa 2004, the main differences with planning poker as I see it practiced today are that estimates were in real time like days or weeks, and votes were collected and displayed anonymously, though as you would expect there was temptation for people to de-anonymize their own votes.

Re:Delphi Method by leetrout on Saturday March 06, 2021 @05:39PM (#26371171)
Ah interesting! Thanks for the link. Everything old is new and the cycle continues.
Re:Delphi Method by markus_zhang on Saturday March 06, 2021 @08:53PM (#26372400)
PM should always work with/as a business analyst to figure out the business requirements. A lot of times it is the ambiguity of business requirements that leads to bad decisions.
Re:Delphi Method by sergiotapia on Saturday March 06, 2021 @11:12AM (#26368360)
That's just planning poker.
Re:Delphi Method by thereticent on Saturday March 06, 2021 @11:22AM (#26368412)
Years ago we used this method with a group of neuropsychologists and physicians to develop an algorithm for clinical decision support for traumatic brain injury and PTSD evaluation at the VA. It helped provide validation of a 3 question screener that would get veterans to the right services while not burdening other vets with an hour long evaluation appointment. The screener is still in use today AFAIK. The Delphi process itself was a cool experience and allowed a lot of "cooler" analytical thought whereas committee meetings tend to have problems with egos and hot takes.
Re:Delphi Method by rini17 on Saturday March 06, 2021 @12:00PM (#26368733)
I have heard about this method in the context of group manipulation - "to be delphied" i.e.: https://anticorruptionsociety.files.wordpress.com/2015/03/de...
Re:Delphi Method by travisjungroth on Saturday March 06, 2021 @12:36PM (#26369011)
That pamphlet is wild. It reads as really paranoid, but I totally agree with it. It seems like Delphi isn't at all resilient to being run by bad intentioned people. This make it terrible for something like setting public policy.

It doesn't make it worthless, though. If you had a 20 person company where ownership was legitimately interested in getting the best answer to the problem, maybe this is an efficient way of doing that.

Re:Delphi Method by 1123581321 on Saturday March 06, 2021 @04:57PM (#26370897)
I got a kick out of the sensational tone. I’ve seen this pattern at many public meetings for spending road improvement budgets and the like. There certainly is no deviation from the plan based on anything that happens in these meetings. However, the participation by the lower level facilitators is more fairly described as work-a-day rather than malicious.
Re:Delphi Method by centimeter on Saturday March 06, 2021 @12:27PM (#26368929)
This is pretty funny. It sounds like some governing bodies the author of this document is familiar with have inappropriately used this forecasting procedure as a governance procedure. This is totally something I can imagine some bright-eyed local politics midwit doing.
Re:Delphi Method by NotPavlovsDog on Saturday March 06, 2021 @04:17PM (#26370591)
thanks for sharing, that was a great find.
Re:Delphi Method by adam on Saturday March 06, 2021 @04:11PM (#26370563)
We do a version of this with our clients, where we use our forecasting software and host a "live" forecasting session. We make people forecast "cold" on something: likelihood of hitting milestones, competitive intelligence, industry trend, whatever, and then have someone come in and give a talk on what we've asked people to forecast. We follow that up with more forecasting and get to see if people were influenced by the expert or not.

Perhaps the most valuable part is the discussion after making that second forecast. We identify a lot of bias and assumptions people were making that they then learn from the next time they have to make a forecast like that.

Re:Delphi Method by minitoar on Saturday March 06, 2021 @10:53AM (#26368192)
Sounds very much like story point estimation that my team does all the time: “The objective of the method was to combine expert opinions on likelihood and expected development time, of the particular technology, in a single indicator.”
Re:Delphi Method by flixic on Saturday March 06, 2021 @11:11AM (#26368348)
Most point estimates I’ve been a part of have not been anonymous. Have you had a different experience?
Re:Delphi Method by minitoar on Saturday March 06, 2021 @11:25AM (#26368434)
No, but as far as I can tell that’s not a requirement for the Delphi method.
Re:Delphi Method by judofyr on Saturday March 06, 2021 @01:30PM (#26369406)
Anonymity is the first “key characteristic” listed and I can’t find any mention on this page that it is optional for this method.

EDIT: Looking more into it, it seems that it went from "Delph method" to "Wideband delphi" to "Planning poker", and it's in the last step that the anonymity requirement disappeared. Very interesting!

https://en.wikipedia.org/wiki/Wideband_delphi

https://en.wikipedia.org/wiki/Planning_poker

Re:Delphi Method by minitoar on Saturday March 06, 2021 @04:58PM (#26370905)
Characteristics are not requirements. Anyway, my original claim was that it was similar not identical.
Re:Delphi Method by samat on Saturday March 06, 2021 @11:54AM (#26368675)
Clicked here expecting some heart touching Object Pascal reveries. Not this time.
Re:Delphi Method by petr25102018 on Saturday March 06, 2021 @02:20PM (#26369741)
I first learned about the Delphi Method from the book Software Estimation: Demystifying the Black Art.

Although I have not used it in practice yet, I like the concept, especially for some more difficult (bigger) estimation tasks, so I am mentioning it in my book besides other "group estimation techniques".

It is true that this is basically async "planning poker".

Re:Delphi Method by bluetwo on Saturday March 06, 2021 @02:24PM (#26369783)
I first learned about it when a client hired me to write software to support this method for use in pharmaceutical planning and marketing. Very useful if done correctly.
Re:Delphi Method by lowdose on Saturday March 06, 2021 @12:15PM (#26368844)
Sounds a lot like reading the comment feed on hn. A panel of experts that have better forecasting abilities than FANG combined.
Re:Delphi Method by datavirtue on Saturday March 06, 2021 @11:01AM (#26368266)
Could this be the solution to the pain of trying to discuss a complex topic in zoom meetings? I kept thinking we should use parliamentary procedure or something but this sounds like less friction and it is mostly what we are already doing but with a little bit of structure.

A Jamboard delphi session perhaps.

Re:Delphi Method by ant6n on Saturday March 06, 2021 @01:47PM (#26369523)
Not to be confused with Methods in Delphi http://docwiki.embarcadero.com/RADStudio/Sydney/en/Methods_(...
Re:Delphi Method by ksaj on Saturday March 06, 2021 @05:51PM (#26371258)
I use this method for interviewing executive, technical and operational groups in security audits. It's much easier to dig down to the truth.
Re:Delphi Method by RootKitBeerCat on Saturday March 06, 2021 @12:37PM (#26369013)
Note: decentralized oracles don’t work, because that middle step of talk / signal doesn’t happen
Re:Delphi Method by faeyanpiraat on Saturday March 06, 2021 @12:46PM (#26369094)
I was excited until I discovered this method requires a committee.
Re:Delphi Method by bluetwo on Saturday March 06, 2021 @02:26PM (#26369797)
They don't have to be in the same physical location as long as you have a means to consolidate feedback.
Re:Delphi Method by astrea on Saturday March 06, 2021 @11:08AM (#26368319)
My university uses this to predict COVID spread: https://delphi.cmu.edu/about/
Re:Delphi Method by jsherwani on Saturday March 06, 2021 @11:24AM (#26368426)
Very cool, how does the team use this method as part of its prediction process?

(Also: Roni, the head of this research group, was my PhD thesis advisor more than ten years ago!)

Re:Delphi Method by wcerfgba on Saturday March 06, 2021 @11:20AM (#26368400)
This research group does not seem to be using the Delphi method described in the OP Wikipedia article, it just has the same name.
Re:Delphi Method by astrea on Saturday March 06, 2021 @01:15PM (#26369295)
Fair, my mistake. I only lightly read the post I'll admit.