News for hackers. Stuff that matters.
Re:Tasking developers with creating detailed estimates is a ... by wpietri on Friday November 19, 2021 @08:28AM (#29276907)
And one of the classic problems with estimates is that common processes tend to bias estimates.

For example, what (I think) McConnell calls "picking the first non-impossible date". An exec asks how long project Magic Pony will take. A manager asks the team and the team comes up with a number. If the number is higher than what the exec imagined, or even higher than what the manager imagines the exec imagines, pressure is applied on the number. "Are you sure? That seems like a lot." A negotiation ensues, and often the number lands on the first date that engineers can't absolutely prove is impossible. Or the first date that engineers won't quit their jobs over.

For an estimate, we in theory want one where the team has a good chance of hitting it. Say, a 75% chance of success. But iterative pressure from the powerful will shift the distribution to 25%, 5%, 1%.

Re:Tasking developers with creating detailed estimates is a ... by quacked on Friday November 19, 2021 @09:47AM (#29277687)
The classic cognitive trick--people, unless specifically trained not to, will always estimate the best possible scenario, even if past experience has told them that the best possible scenario never happens.

I'm dealing with this at my company right now. Our clients, and even our internal teams, will always refuse to estimate according to our past behavior.

Us: "We estimate your build will be functional in prod in five months."

Client: "Unacceptable. That's way too long. We need it in three."

Us: "Okay, we technically can do that, but that relies on a big internal release that we think is risky to base estimates on."

Client: "All I'm hearing is that you can do it in three."

Then we get to three months and hit delays over and over again until finally, five months later, the build is functional in prod.

The thing that really frustrates me is that when we deliver the initial estimate, the clients always refuse to accept our medium-case estimate, with the implication that they'll drop us as a vendor if we follow that. So we give them our best-case estimate, fail to hit it, and then they buy more from us anyway, complaining the entire time.

Why don't we all just look at the past 10 builds we delivered for them, admit that the best-case never happens, and stop pretending like it's unacceptable to take longer? The point here is that they keep accepting it. Everyone complains, but we all keep selling and buying to and from each other. Let's just admit it's harder than we're saying to get software built and accept longer estimates, given that we're all going to keep selling and buying anyway.

Re:Tasking developers with creating detailed estimates is a ... by mgkimsal on Friday November 19, 2021 @11:07AM (#29278618)
> Why don't we all just look at the past 10 builds we delivered for them, admit that the best-case never happens, and stop pretending like it's unacceptable to take longer? The point here is that they keep accepting it.

It's theater, mostly. I think some people think they have to do this. How did they get you to keep delivering when you did? It was their threats/complaining! If they stopped doing that... there's no telling how long it might take you to deliver.

Given that every project you've called at 4 months has delivered in ... 4 months, for the past 7 years... your estimating/delivery ability is still tangential to their managing of the delivery by regular barrages of threats, complaints and haranguing.

Re:Tasking developers with creating detailed estimates is a ... by wpietri on Friday November 19, 2021 @01:15PM (#29280392)
Wow, great insight.

It reminds me of the dynamics with walking down the sidewalk past a dog. If I walk too close to his yard, he decides I'm a threat. He barks! I walk away. It's easy for him to do post hoc ergo propter hoc and conclude that his barking chased away a dangerous threat. In reality I didn't do a thing different, but his lesson is that barking works!

Re:Tasking developers with creating detailed estimates is a ... by quacked on Friday November 19, 2021 @01:16PM (#29280419)
It's a great point, and one that could be rectified by their teams actually having standards. Threats can't be empty. "Deliver early, we'll give you a bonus. Deliver on-time, we'll pay. Deliver late, we'll hold you accountable and pay less according to this attachment. Deliver really late, and you get a strike. Three strikes and we drop you."

Of course, that would require backbone, fortitude, accurate forecasting, integrity, and management support.

Re:Tasking developers with creating detailed estimates is a ... by ianmcgowan on Friday November 19, 2021 @05:02PM (#29283161)
I've had arguments with PM's about this. After a few years of doing similar projects you can sort of squint sideways at something similar and have a gut feel (if it's completely different from anything ever done, that doesn't work of course).

But every PMP (tm) certified PM I've worked with thinks if you can just break the project into granular chunks, estimate those, then sum the estimates, there's your final deadline. The fact that it never works doesn't dissuade them on the next project is the depressing part, it's all just theatre for the execs.

Re:Tasking developers with creating detailed estimates is a ... by wpietri on Friday November 19, 2021 @10:15AM (#29277998)
Totally. In most places what people call "estimates" are just wishful thinking.

And that client behavior you describe is what I think of as "Kirk-style management". An executive thinks that the way to get technical things done is to be demanding and shouty toward the technical person, insisting that the number given isn't good enough. Scotty's pathological response to the pathological situation was to lie his ass off about estimates: https://wiki.c2.com/?ScottyFactor

Re:Tasking developers with creating detailed estimates is a ... by quacked on Friday November 19, 2021 @11:05AM (#29278578)
Thanks for that article--bookmarked.
Re:Tasking developers with creating detailed estimates is a ... by myohmy on Friday November 19, 2021 @05:55PM (#29283678)
All I'm hearing is that the client signed the contract, which means you won.

Whether your company makes money on the change order is a matter for your boss.

Re:Tasking developers with creating detailed estimates is a ... by RegW on Friday November 19, 2021 @12:08PM (#29279483)
One technique is to ask for 3 point estimates. Get everyone involved to estimate each item in three different ways:

1. How long it will take if everything goes well and according to plan.

2. How long it will take if everything goes wrong and we uncover further problems along the way. Probably getting those risks listed.

3. How long it is likely to take.

I imagine we tend towards doing just one of the first two, but having to do both should lead to more agreement on the third.

That said - its been about 30 years since I was taught this as part of critical path analysis, and I've never seen it used in the wild.

Re:Tasking developers with creating detailed estimates is a ... by regularfry on Friday November 19, 2021 @12:40PM (#29279939)
The problem even with that method is that if everyone agrees on "most likely", and that is perfectly correct, and you use it, you'll still be wrong more often than right.

The reason is the underlying distribution: because the probability distribution is usually heavily skewed to the left, with a long tail to the right and lots more room for things to extend than to contract, the day which is "most likely" when looked at in isolation is actually well to the left of the median date, the date with a 50% probability of being before or after completion.

If you want an 80% chance of being right, say, you need to do some more maths with the three numbers to figure out what the right date to use is.

I would very much like to see this done. The problem is that estimation isn't seen as work. It's seen (or, more accurately, framed) as something devs should be able to just magic from thin air with perfect accuracy, so why would we bother adding complexity? Very few organisations bother tracking estimation precision, I think because the incentives are aligned such that it's actually to the advantage of the people writing the cheques that developers under-estimate. I think the power over the developers that a missed estimate gives to an adjacent organisation is a real factor in ensuring this never gets improved.

Re:Tasking developers with creating detailed estimates is a ... by drdec on Friday November 19, 2021 @01:10PM (#29280331)
> you need to do some more maths with the three numbers to figure out what the right date to use is.

We did this all the time at a previous job. We had a spreadsheet in which we put in the three estimates. They were combined in some ratio (I think it was 1 part each for the outliers and 2 parts for the most likely). Then some time was added on for testing, test remediation and project management at a set additional percentage. Worked out pretty well, we seldom ended up with issues when using this method.

Re:Tasking developers with creating detailed estimates is a ... by regularfry on Saturday November 20, 2021 @06:31AM (#29287160)
Tom DeMarco describes a method in Waltzing With Bears that's quite interesting: use a triangle defined by the three points as a rough approximation for the probability distribution, and then cumulative distribution function calculations are just juggling quadratics that you can plug into Excel.

Mind you, these days Excel's got the distribution function formulae in it that you'd need to do it "properly" with a lognormal distribution, but I like the way the three estimation points have a direct and obvious link to the result with the triangle method.

Re:Tasking developers with creating detailed estimates is a ... by wpietri on Friday November 19, 2021 @12:29PM (#29279777)
For sure. I know plenty of ways to deliver solid estimates and hit dates. I think the problem is execs mostly prefer having estimates they like over accurate estimates.
Re:Tasking developers with creating detailed estimates is a ... by denton-scratch on Friday November 19, 2021 @12:56PM (#29280163)
> A negotiation ensues

... and then the estimate is no longer an estimate, it's the outcome of a negotiation.

> Are you sure? That seems like a lot.

"No, I'm not sure, boss; it's an estimate."