News for hackers. Stuff that matters.
Re:Why are developers expected to estimate tasks at all? by WastingMyTime89 on Sunday March 26, 2023 @02:48PM (#35317982)
> The developer says “there are too many unknowns to provide any sort of estimate”.

You are misunderstanding your job. You are a subject expert and paid accordingly. Answer with what the unknowns are, an optimistic and pessimistic take on them, what you could do and how long it would take to lift them.

If you don’t, your boss is going to ask you for exactly that in a roundabout way and micromanage you because you are forcing them to do your job.

It still baffle me than approximately half of developers don’t understand things which are obvious to any seasoned blue collar worker.

Re:Why are developers expected to estimate tasks at all? by mumblemumble on Sunday March 26, 2023 @03:46PM (#35318751)
Blue collar vocational training is more mature than software development vocational training. It's typically taught by people who have professional experience, and there may even be an apprenticeship period where people are explicitly learning from an expert in their profession while on the job.

In software, on the other hand, we often have most training being taught by professional academics who do not understand and are not qualified to teach the parts of the job that don't have a straightforward academic analogue. Combine that with a business environment where things like budgets and cost control are often only theoretical, and all but the most gross liability for defects due to poor workmanship has been waved away by EULAs, let it marinate for several decades, and... yeah. Not only do people not know these things, but I'm not entirely clear on how or why they should be expected to learn them, either.

Re:Why are developers expected to estimate tasks at all? by Scarblac on Sunday March 26, 2023 @04:07PM (#35318980)
I mostly agree, but if it's a technology I've never worked with and I'm asked to do something I've never done before, I'm not an expert. That doesn't stop them asking for estimates, which turn into deadlines.
Re:Why are developers expected to estimate tasks at all? by bluedino on Sunday March 26, 2023 @04:13PM (#35319038)
That's a special case then.
Re:Why are developers expected to estimate tasks at all? by re-thc on Sunday March 26, 2023 @09:59PM (#35322024)
You mean we're all a special case :)
Re:Why are developers expected to estimate tasks at all? by magicalhippo on Sunday March 26, 2023 @04:56PM (#35319516)
I just say that to my boss: "this would involve using a library/tool I've not yet used, so I cannot give a good estimate until I've spent some time digging into it. Right now I don't know if it will be easy or very difficult."

If he really needs an estimate he'll tell me to start digging into it right away, and I'll let him know after a bit of time how it's going. If there are still large uncertainties and my boss still wants this completed by some specific date, we might try to explore alternative solutions.

Re:Why are developers expected to estimate tasks at all? by Scarblac on Sunday March 26, 2023 @05:12PM (#35319689)
Yes it boils down to, if the person asking for estimates understands the problems with them, it's safe to try. With bad managers it's better not to give them as they will be abused.

In the above case, I didn't get that time I would need, they wanted the estimate to include that time I would need to dig into it. But that's above my estimation powers. I didn't even know if what they asked was possible at all.

They went and asked someone else who did guess some number of weeks, but the work never got priority so we still don't know.

Re:Why are developers expected to estimate tasks at all? by magicalhippo on Sunday March 26, 2023 @06:17PM (#35320236)
> they wanted the estimate to include that time I would need to dig into it

Yeah that ain't gonna fly with me.

Re:Why are developers expected to estimate tasks at all? by mewpmewp2 on Sunday March 26, 2023 @08:58PM (#35321591)
Did you say what you are saying here?

Did you say that

1) Without knowing further best case is it takes N time, worst case M time, and if there are certain obstacles it could be completely unfeasible. 2) To get more accurate time and to understand whether it's feasible I would need O time to figure that out first, and I can give you the more accurate estimate then.

Re:Why are developers expected to estimate tasks at all? by IIsi50MHz on Sunday March 26, 2023 @10:56PM (#35322364)
This seems unexpectedly optimistic, to me. I'd think: best case = it's already done; worst case = it's impossible, but we don't know that until we've spent too much time and money on it; the "certain obstacles" are almost always uncertain or completely unknown; and the "O time to figure out [how much time it will take] is also unknowable until the "figuring" is already complete. Now, if this were manufacturing with well-known processes, then I feel I could use your formula.
Re:Why are developers expected to estimate tasks at all? by Scarblac on Monday March 27, 2023 @01:37AM (#35323216)
Yes, of course. To the bad managers it sounds like just yet another excuse, and they ask other devs until they find one who gives a number.
Re:Why are developers expected to estimate tasks at all? by asielen on Monday March 27, 2023 @01:13AM (#35323077)
As a manager that's all I ask. Give me an estimate of the knowns and an estimate on how's long you need to figure out what is realistic from the unknowns. Just let me know what your next move is.

The problem is when we assume everything is a known. I try not to do that and I try to set that expectation with my manager. If everything had an easy answer we wouldn't need highly paid problem solvers.

Re:Why are developers expected to estimate tasks at all? by lutorm on Sunday March 26, 2023 @05:26PM (#35319804)
estimates, which turn into deadlines

Well, that's the problem right there. An estimate is not a promise. It should not be treated as such.

Re:Why are developers expected to estimate tasks at all? by barrysteve on Sunday March 26, 2023 @04:07PM (#35318984)
Can you do it? Provide an estimate that's accurate and stick to it with the routinized scheduling of a blue collar job?

It's not an apples to oranges comparison. You give me an architect's blueprint and guys who build to the legal building code, and I could probably get a house built. Expensive and painfully, but it can be done.

I don't even know what the coding analog to an architect's blueprint is. They are fundamentally different jobs.

Re:Why are developers expected to estimate tasks at all? by WastingMyTime89 on Sunday March 26, 2023 @04:12PM (#35319030)
> Can you do it? Provide an estimate that's accurate and stick to it with the routinized scheduling of a blue collar job?

Yes, I work as a delivery lead nowadays. Producing and respecting estimates for software projects is literally my job.

I routinely fire developers who pretend they can’t do estimate and strangely the ones I keep are actually not only able to do it but good at it.

Re:Why are developers expected to estimate tasks at all? by barrysteve on Sunday March 26, 2023 @04:56PM (#35319510)
Fair enough. Guess I should admit you squarely got me.
Re:Why are developers expected to estimate tasks at all? by firstlink on Sunday March 26, 2023 @09:31PM (#35321835)
You just made two contradictory claims: (a) that your job is to produce estimates; (b) that the developers who you work with are the ones who need to "do" the estimates.

I've met your sort before. You're a net waste of resources in an org: instead of developers getting things done, they're dealing with you asking them to do your job for you, i.e. produce estimates for the things they'll never actually get around to doing (because of producing estimates).

Your username would be accurate if s/My/Everyone's/

Re:Why are developers expected to estimate tasks at all? by WastingMyTime89 on Monday March 27, 2023 @07:31AM (#35325316)
I produce estimates and coordinate eight concurrent projects involving ~70 people in cross functional teams. At some point, the actual domain experts have to give me their inputs so I can consolidate and prioritise things. Nothing contradictory here.

If it helps you sleep at night, sure, assume I’m a net waste of ressource. Good luck fighting with the other seven teams for some time with the shared senior UX expert.

Re:Why are developers expected to estimate tasks at all? by wruza on Sunday March 26, 2023 @09:47PM (#35321931)
Are you sure you’re not mistaking guess=deadline mode for actual estimating? And selecting among those who can meet deadlines.

If you rarely eat your time buffers, great. If you do that often, maybe you just coinflip-fix deadlines this way and maneuver between them under the guise of successful estimation.

Re:Why are developers expected to estimate tasks at all? by re-thc on Sunday March 26, 2023 @10:11PM (#35322106)
It's more likely than not that everyone is giving the wrong estimates i.e. just claim things take 3x as long, skip out on anything too hard and produce lower quality.

You always get what you ask for. Like sure I can estimate. If you ask for a web server you'll just have that. It won't be secure. It won't be fast. It may work. It will certainly pass the tests you think of.

Is that actually good? No. The real estimates get rejected. Everyone cuts corners. When something does happen e.g. a hack occurs the engineers not these managers get fired :(

Re:Why are developers expected to estimate tasks at all? by lamontcg on Sunday March 26, 2023 @04:17PM (#35319087)
> You are misunderstanding your job. You are a subject expert and paid accordingly. Answer with what the unknowns are, an optimistic and pessimistic take on them, what you could do and how long it would take to lift them.

My optimistic/pessimistic takes at my last job would look something like "roughly a week to roughly 2 years"

Depends on how deep the yak shaving goes, and you wouldn't know until you got halfway through fixing the problem.

Often I could take an educated guess as to which side of the scale it came down on, but I've definitely started pulling on a string inside of the codebase and it just kept going and going and going. All of those baked-in assumptions that other developers unconsciously made over the course of a decade can pile up into a mess that you just can't implement the feature/bugfix without doing a pile of potentially breaking changes that need to be shipped in major versions.

Generally if I worked the problem for a week then I could give you a much better estimate of when it would be done, and often that estimate was "it's done now" after a week. But if I hadn't looked at that particular subsystem for a few years, I couldn't trust my memory of it up front and had to do exploratory surgery first.

(Really exploratory surgery is a much better metaphor for what you're going to be doing, and surgeons can routinely find surprises -- "oh look that barely perceptible shadow on the x-ray turns out to be a stage 4 tumor...")

Yes, the codebase was horrible, yes it needed to be cleaned up, no we didn't have the manpower to do that and it would have taken me 10 years to rewrite it all.

Quitting of course was an excellent solution.

Re:Why are developers expected to estimate tasks at all? by firstlink on Sunday March 26, 2023 @09:28PM (#35321818)
> Generally if I worked the problem for a week then I could give you a much better estimate of when it would be done, and often that estimate was "it's done now" after a week.

You're lucky if your management chain allows you to work on problems for as long as a week without giving them an estimate first.

Re:Why are developers expected to estimate tasks at all? by locustous on Sunday March 26, 2023 @04:25PM (#35319177)
> You are misunderstanding your job. You are a subject expert and paid accordingly. Answer with what the unknowns are, an optimistic and pessimistic take on them, what you could do and how long it would take to lift them.

Add a small feature to an existing system. This estimate can be anywhere from several months to a day. Most of the error bars are org and system specific rather than anything to do with the feature. The exact same feature built by the same person in different orgs and different systems can be opposite ends of the range.

Seldom do people have the contextual understanding to provide an accurate narrow estimate, particularly since both org and system are in flux. They change constantly. Unseen landmines potentially await in both.

> If you don’t, your boss is going to ask you for exactly that in a roundabout way and micromanage you because you are forcing them to do your job.

And such orgs take forever to get anything done.

> It still baffle me than approximately half of developers don’t understand things which are obvious to any seasoned blue collar worker.

Software is probably the hardest kind of engineering you can do. All the system constraints are virtual. Just consider comparing a dirt ground for consistency and behavior vs libc... 304 stainless vs react.

You can go deep in both, but a shallow understanding of one takes you much much further than a shallow understanding of the other.

Re:Why are developers expected to estimate tasks at all? by WastingMyTime89 on Sunday March 26, 2023 @04:57PM (#35319530)
> Add a small feature to an existing system. This estimate can be anywhere from several months to a day.

That’s extremely untrue in my experience. Sure, hard to interface with systems are a thing and organisational roadblocks happen but an onboarded senior team member can tell you what’s going to take days and what’s going to take months or they have no business being senior in the first place.

I feel like my answers in this discussion have been particularly harsh but I would really like people calling themselves software engineers to start acting like some. I think my view on this subject has been strongly shaped by spending most of my career doing software development for industrial companies: people who claim software is particularly complicated just don’t understand and respect how complex the rest of an industrial project is.

Re:Why are developers expected to estimate tasks at all? by tremon on Sunday March 26, 2023 @05:17PM (#35319724)
an onboarded senior team member can tell you

You're making an unwarranted assumption here. There's many pieces of software that have no development team at all. There's no one to ask; the last person to touch this software left the company three years ago. All they can tell you about it is how they use it now.

It's likely there's at least someone that can explain their business process to you, but identifying them and receiving enough of their time to piece the picture together is another story. And maybe, if you're lucky, that person can tell you what the business process was at the time the software was written, and what has changed since then.

But this process can take weeks, and most of the time you're expected to provide an estimate before even talking to anyone from operations.

Sure, for internal software with an active maintenance/development team, informed estimates can be given with a relatively high level of confidence. But as an outside consultant working with non-software companies, all estimates are completely made-up based on your reading of the buyer's budget: there are no other data points to base your estimate on.

Re:Why are developers expected to estimate tasks at all? by WastingMyTime89 on Sunday March 26, 2023 @05:34PM (#35319877)
> outside consultant working with non-software companies

Development by outside ressource happening on custom pieces of software from non-software related companies is such a niche it might as well not exist. I don’t think it’s a very useful datapoint in a discussion about estimation in software development. Plus, as someone contracted, I’m fairly sure you actually have a rough idea of the effort involved or you would have become insolvent already.

Re:Why are developers expected to estimate tasks at all? by re-thc on Sunday March 26, 2023 @10:04PM (#35322058)
There are lots of places where you get 0 of that before providing an estimate.

And yes they are still solvent.

As others mention there are lots of unknowns in an organization.

I've been in places where the other team involved is across the globe in a different timezone and isn't even actively willing to respond and yet we continue...

There are also cases where lots of parts are outsourced and you're lucky to get a reasonable response i.e. changing part x requires vendor a, b, c & d, which have an SLA 1-8 weeks and so you're already starting 4-32 weeks without even working anything else out. If you're really lucky it could still all be done in 1 day.

Not sure if you're harsh as you say or just lucky. Not everyone and every team is well organized.

Re:Why are developers expected to estimate tasks at all? by magicalhippo on Sunday March 26, 2023 @04:47PM (#35319406)
> Answer with what the unknowns are, an optimistic and pessimistic take on them, what you could do and how long it would take to lift them.

Yeah, most of the time my boss just needs to know if this job is a few hours, a few days or a few weeks. I never answer with exact numbers, but a range. If there are some major unknowns I let him know. If I made some important assumptions then I let him know.

Sometimes I'm wrong. Most of the time my estimates are sufficiently accurate.

Sometimes the customer really needs this done before some deadline. Then it often turns into "how can we make this happen before then". After a bit of back and forth with some added assumptions and cutting functionality, we usually end up with a solution that can be realized in time.

Re:Why are developers expected to estimate tasks at all? by dgb23 on Sunday March 26, 2023 @05:18PM (#35319739)
I usually give estimate ranges. And more importantly, I state my assumptions.

Assumptions can range from “if this API can be consumed in a usual manner and is well documented” to “if these clarifications are made in time” to “if the domain experts test the feature on our dev environment and give timely feedback”.

I try to communicate clearly that it’s almost always a two way street.

Yes I’m the technical expert, but they are the domain expert. I need their understanding and feedback to make something that’s useful.

The best clients understand this very well. Those also get priority and sharper estimates.

Re:Why are developers expected to estimate tasks at all? by iamcasen on Sunday March 26, 2023 @06:17PM (#35320238)
Thank God somebody said this. When I was working as an IC, I would be very communicative, highlight the unknowns, and get buy-in from my boss. If a surprise came up, I would make sure everyone knew the game had changed.

As a manager now, I get scoffed at if I even hint at a deadline. Excuse me what? We have a limited budget, a limited runway, and we need to prioritize which product bets we are going to make. This seems entirely logical, but a lot of devs I work with now find it impossible. They just enjoy tinkering away with whatever thing interests them, and delivering value only means what they personally find valuable.

Personally, I find it a bit pathetic and childish. I say this as a long time software engineer who knows perfectly well how this business works.

Re:Why are developers expected to estimate tasks at all? by pylua on Sunday March 26, 2023 @06:36PM (#35320417)
Will Wright had a quote on this … if you don’t have any constraints you are just playing.

That said, however, The problem I run into during practice is dependencies— people want estimates to integrate into systems you have never heard of or used before. Not only that, there is no in place architecture or design before estimation. Imagine a construction company estimating a house without knowing how big it is or without having blueprints.

Often times software development is designing and architecting the system — not just implementing it. And that is the expensive part.

Re:Why are developers expected to estimate tasks at all? by mewpmewp2 on Sunday March 26, 2023 @08:55PM (#35321560)
Then you communicate!

Say that the estimation can depend on the complexity of the system. I would think worst case is when the system has these A, B problems, then it would take N time. Otherwise best case it could take M time. If we want more accurate idea, we can spend O time on it to figure out what it could be.

Re:Why are developers expected to estimate tasks at all? by pylua on Monday March 27, 2023 @08:06AM (#35325599)
I would say this is being negligent if it is generalized. Often times architecting a system involves meetings with multiple parties — stake holders , legal counsels, and months or years of planning ahead to give a proper estimate for a large system. Time and materials is the right way to do this. However I can see this working in a very small scenario.
Re:Why are developers expected to estimate tasks at all? by re-thc on Sunday March 26, 2023 @09:57PM (#35322005)
> Personally, I find it a bit pathetic and childish. I say this as a long time software engineer who knows perfectly well how this business works.

How does this business work?

Why is software special? This happens the same in construction and other industries. The estimates usually make 0 sense and there are often huge delays. Same as store openings, film production, etc.

There's a problem with tinkering and devs going off in the wrong direction but on the flip side when people say that something is done in an hour or a day often never happens. Managers and agile practices that want tasks broken done to the smallest atom just messes things up. To make things work product often never has accurate requirements to that detail either so that complicates things even more. The requirements change on the fly.