News for hackers. Stuff that matters.
Re:Against software development by beat on Friday November 09, 2018 @10:33AM (#18415103)
I've been meaning to give a lightning talk about a related subject someday, called "Why Software Sucks".

Basically, software hovers along the fuzzy line between "barely works" and "doesn't work". When we start a project, it doesn't work. We add code until it barely works. Then we break it, so it doesn't work. So we add enough scaffold that it barely works and can support the new features, until we break it again, and the cycle begins anew. This is actually embedded as principle in TSTTCPW (the simplest thing that could possibly work), but attempts to waterfall our way out by careful planning are generally doomed, due to unintended consequences and such.

Eventually, the software becomes broken and no longer worth fixing (and thus gets abandoned), or it hits feature complete while (barely) working. And what happens when it's "complete"? Do we say "Thank goodness, finally I can go fix all those bugs and design flaws!"? No, never.

Instead, we drop that blecherous losing piece of crap as fast as we can and go start on the shiny new project that's been cooking in our minds, the one we couldn't work on because we were hacking our way through the wretched ball of mud that is our old code, wasting time in frustration and shame, just to get it off our plate. So we start working on the shiny new thing. And this time, the code will be good. This time, it won't suck.

Yeah, right.

Re:Against software development by athenot on Friday November 09, 2018 @10:59AM (#18415348)
This really depends on the kind of industry. If we follow the money trail, software exists to achieve a business goal, either directly or indirectly. As with most things in business, what matters is "good enough".

Some software exists outside of this environment, usually because it is beholden to an impeccable level of quality (defined as never caught in a non-deterministic state, resillient, etc). This can be:

— software used by millions of people, all poking at obscure edge cases;

— software used by lots of other software, for the same reasons;

— software commissioned by high stakes businesses (space, life-support systems...), where the amount of life or money lost, should the software fail, is simply unacceptable.

This in turn guides what I decide to work on. If your employer/client views your software purely as a cost center, you can guarantee the quality you are allowed to deliver will always remain mediocre. Good enough to support the business but no more. I learned to stay away from those industries.

Re:Against software development by beat on Friday November 09, 2018 @12:18PM (#18416033)
I used to work on a system that moved a hundred billion dollars a day. Yes, billion. Downtime costed thousands of dollars a minute simply in floating interest from money not moving, and a serious outage could damage the entire economy. That's some serious high availability requirements.

For purposes of its extreme performance and availability requirements, it barely worked. That doesn't mean it was bad code! It was great code. But it could have been better. It could have been much better. And it wasn't, because once it met those requirements, work got applied to expanding its feature set instead. Which was, in a way, also a requirement.

Pick any "impeccable level of quality" system, and you'll find the same thing. Heart monitors. Mars launches. Whatever. The software barely works, given the difficulty of the requirements. I'd argue that it's actually irresponsible for businesses to try to do any better than that! The cost of bouncing the rubble with code quality is a resource that could be much better spent on other things.

Think of it in terms of the 80/20 rule. Dig into that last 20%, and you'll spend 80% of your effort on it. It's not a good tradeoff. The Pareto Principle isn't a measure of how bad we are, it's a measure of how good we are. When we attend to its wisdom, we get the most work done.

edit: Scope is not the only requirement. Schedule is also a requirement! Pareto Principle again! Taking four times as long to get 20% better code is failure. We don't just have to create features. We create features with the resources we have, the technology we have, the people we have, within the schedule we have. A blown schedule is a failed requirement. Software not delivered on time is, in fact, broken.

Re:Against software development by cleong on Friday November 09, 2018 @01:59PM (#18416910)
By definition wouldn't all bridges "barely work"? Yes it's spec'd to handle X load, now putting X+1 might cause some damage because it was never tested or designed for X+1.
Re:Against software development by jungler on Friday November 09, 2018 @08:10PM (#18419329)
All bridges follow similar designs, even if their implementations are original. Digital systems tend to fail in original ways all the time, because the design is something intentionally new. If it weren't, you'd just copy the existing software.

Which doesn't mean that we have no reusable or generalizable quality metrics - we do. But they tend to express things that correlate to an abstract of quality, and not a failure threshold.

The most honest systems in software are the ones that do not scale, because they have built in their hard failure point - and from that, tolerance metrics similar to bridges can be predicted and planned for. It's software that has to do everything in a multitude of configurations at great speed that runs into deep architectural issues, because it hypothesizes a bridge that will someday tolerate an infinite load.

Re:Against software development by faitswulff on Friday November 09, 2018 @12:40PM (#18416238)
What do you mean by barely working (and as a corollary, does it even make sense for it to do more than that)? The spectrum of correctness seems quite limited; you said it yourself, software starts out not working, and then when it's correct, it works. It seems pretty binary to me. Do you mean that the software is brittle, doesn't handle edge cases, has bugs, etc? It seems to me that once software is correct, there's not much more to do in terms of working.
Re:Against software development by beat on Friday November 09, 2018 @02:11PM (#18417017)
Yes, I mean brittleness, inability to handle edge cases, etc. Oftentimes, this means that it's boxed-in and can't grow in certain necessary directions without major rework.

For example, take a deployment configuration where the target environments are hardcoded, with duplicate-minus-variation configuration files. Works fine, for the existing environments. But it can't handle a new one, not without duplicating again. Correcting this means going to some sort of a template configuration with parameters in a data store.

Bit rot is part of this. Works fine in Windows 10, but it'll fail come Windows 11, etc.

And yes, part of what I'm arguing is that it doesn't even make sense for software to be better than barely working. I've hit a point where I think code that works too well is a project management smell.

Re:Against software development by hellisothers on Friday November 09, 2018 @11:12AM (#18415465)
As I was reading this post I was about to reply with something similar but you nailed it. The vast majority of software written isn’t there just to be pretty, it serves a business goal and as long as that goal is met (on time!) and the cost of supporting it is within budget then why fix something that isn’t broken.
Re:Against software development by nathcd on Friday November 09, 2018 @11:26AM (#18415574)
For a (not lightning) talk on the subject, I recommend "The Mess We're In" by Joe Armstrong: https://www.youtube.com/watch?v=lKXe3HUG2l4
Re:Against software development by fjsolwmv on Friday November 09, 2018 @10:47AM (#18415235)
The whole world hovers between barely works and doesn't work. That's the theory of evolution that explains the history of life.
Re:Against software development by gglitch on Friday November 09, 2018 @11:37AM (#18415666)
Nice observation. I would enjoy a Tao of System Design that coyly smiles and says, The architecture that can be defined is not the true architecture.
Re:Against software development by gmfawcett on Friday November 09, 2018 @12:54PM (#18416360)
It's not nearly as pithy, but I think that this line from "Big Ball of Mud" captured something essential:

> "Architecture is a hypothesis about the future that holds that subsequent change will be confined to that part of the design space encompassed by that architecture."

http://laputan.org/mud/mud.html#Forces

Re:Against software development by beat on Friday November 09, 2018 @12:11PM (#18415969)
EXACTLY.
Re:Against software development by skybrian on Friday November 09, 2018 @12:18PM (#18416030)
On the other hand, you have redundant systems where everything seems fine even if some parts are not working. If you don't have good monitoring, you won't notice when you break something until other things break as well. Or maybe it doesn't stop working and you just have mysterious brownouts or irreproducible bugs?

Generally speaking, programming is easier when you have clear feedback. Things either work or they don't, and you don't have to do a lot of expensive testing to gather statistics to show there's a bug.

Re:Against software development by erikpukinskis on Friday November 09, 2018 @01:43PM (#18416750)
I wouldn't say that redundancy is the alternative to brittleness.

The altnernative is smaller code, less tightly coupled, that uses fewer libraries and more beginner level language constructs.

There's no technical impediment to that. It's actually less work technically. It's just hard to design that way, because you have to actually understand your domain much more deeply.

That's where stability comes from, not redundancy but the opposite of that. Fewer parts, better understood.

Re:Against software development by skybrian on Friday November 09, 2018 @02:39PM (#18417224)
In a minimalist design, everything has a purpose, so if you remove it, it breaks. That seems good.

And yet, brittleness is supposed to be bad. How is it different?

Re:Against software development by erikpukinskis on Monday November 12, 2018 @02:24PM (#18434926)
I would say minimal means something like "just enough flexibility to support one stated use in all predictable contexts".

Brittle means "not enough flexibility, so it breaks in some contexts".

Removing a component is not a stated use. If a component can be removed during the stated use then that's not minimal, it needs more thought or parts.

Re:Against software development by gglitch on Friday November 09, 2018 @10:57AM (#18415331)
I don't disagree with this, and I'm sure I'd promote the talk, but I'd love to see counterexamples. SQLite?
Re:Against software development by cntlzw on Friday November 09, 2018 @10:44AM (#18415212)
A lightning talk I would love to attend.