News for hackers. Stuff that matters.
Re:Who builds a house without drawing blueprints? (2015) by doctor_eval on Thursday June 11, 2020 @05:56AM (#23487014)
I don’t actually disagree with anything in the article, but comparisons between software and buildings - especially buildings - leave me cold.

There is almost nothing actually in common between software and buildings. You can’t move a house as a matter of course. You can’t modify a house in a few keystrokes. You can’t just copy a house or delete it. You don’t generally consider how a house will evolve over time. A house has a limited number of possible states, and a trivially low number of entrances and exits. The analogy is so poor that it’s difficult even to make analogies about how bad an analogy it is.

I have thought for a long time that building analogies are horribly ill suited to software. Perhaps better than nothing, but only barely. Software is a thing unto itself and I just find these analogies make we want to run away screaming.

Re:Who builds a house without drawing blueprints? (2015) by paulmooreparks on Thursday June 11, 2020 @06:02AM (#23487066)
As the article states, "However, metaphors can be misleading, and I do not claim that we should write specifications just because architects draw blueprints."

He's not arguing for specifications because architects draw them for builders. Rather, architects draw them for some of the same reasons that the author posits that software specifications should be written.

As it says elsewhere... "[A]s the cartoonist Guindon wrote: 'Writing is nature's way of letting you know how sloppy your thinking is.' We think in order to understand what we are doing. If we understand something, we can explain it clearly in writing. If we have not explained it in writing, then we do not know if we really understand it." That's why one should write specifications.

Re:Who builds a house without drawing blueprints? (2015) by TheOtherHobbes on Thursday June 11, 2020 @06:07AM (#23487103)
A written software specification can still be spectacularly wrong. Writing down a spec is no guarantee that you have avoided fuzzy and incomplete thinking or that you understand the problem you are trying to solve.
Re:Who builds a house without drawing blueprints? (2015) by paulmooreparks on Thursday June 11, 2020 @06:11AM (#23487133)
Also covered in the article.
Re:Who builds a house without drawing blueprints? (2015) by doctor_eval on Thursday June 11, 2020 @06:09AM (#23487117)
Like I say, I don’t disagree with anything in the article. In fact I’d go further and say that the metaphor is not just misleading, but actually damaging.
Re:Who builds a house without drawing blueprints? (2015) by WJW on Thursday June 11, 2020 @06:18AM (#23487185)
I wonder how architects would go about their jobs differently if they could build a new house in a few seconds, run a few thousand unit tests on it and then tear it down again at almost zero cost.
Re:Who builds a house without drawing blueprints? (2015) by goalieca on Thursday June 11, 2020 @07:37AM (#23487720)
They can in modelling tools.
Re:Who builds a house without drawing blueprints? (2015) by WJW on Thursday June 11, 2020 @08:16AM (#23487998)
Do they actually run unit tests over those? I've seen the VR modelers where you can "walk" through the builidng but those didn't really verify whether there was enough room in the walls for piping, light fall, floor strength limits, fire requirements etc.

I know at least one department in the Dutch navy was using constraint solvers to design a new submarine class but I haven't heard about a lot about house design. Not a home architect though, so maybe I just haven't kept up to the state of the art there.

Re:Who builds a house without drawing blueprints? (2015) by tonyarkles on Thursday June 11, 2020 @08:48AM (#23488223)
> do they run unit tests on those

My initial glib answer is “no, the engineers are stuck to deal with the bad design afterwards” :)

My less glib answer would be that most disciplines of engineering do do modelling and “virtual testing”. I’ve been working on largish drones for about 18 months. Electronics get specced out, circuits get drawn and simulated, currents are estimated and components are specced based on those estimates, etc. On the mechanical side, parts are drawn in CAD, analyzed for proper fit and assemble-ability, FEA is used to determine whether a part is likely to be strong enough for the static and dynamic loads that will be placed on the aircraft, etc. All of this happens, generally, before circuit boards or modules get ordered or before the first chunk of aluminum goes into the CNC.

As far as building software goes, I’ve recently had to start digging into DO-178C, and I’m pretty impressed so far. Despite having been through engineering school (EE), I haven’t ever really had to put this level of rigour into practice for software before.

It feels slow and somewhat time consuming, but I’m feeling more and more confident that the module I’m working on is going to be pretty damned robust. It’s not a “certification required” unit, but it would be a huge pain in the ass if it failed and couldn’t recover without human intervention; as a result I’m doing more of a “DO-178C lite” with detailed low-level requirements stated explicitly, system architecture drawn out first, sequence diagrams for the complicated event-driven parts, state charts for the different parallel systems, etc.

Re:Who builds a house without drawing blueprints? (2015) by hwayne on Thursday June 11, 2020 @12:23PM (#23490441)
Re:Who builds a house without drawing blueprints? (2015) by RealityVoid on Thursday June 11, 2020 @08:17AM (#23488006)
And that's the thing, the code _is_ the blueprint. What is code if not a sufficiently detailed specification?
Re:Who builds a house without drawing blueprints? (2015) by tonyarkles on Thursday June 11, 2020 @09:59AM (#23488949)
That has, until recently, been my philosophy for a long time. See my sibling comment for context.

Another example of where modelling both saved time and helped make a system more reliable: about 6 months ago, I took on a project that involved integrating a Bluetooth-Iridium gateway into an existing app, so that the app could work in areas with no wifi or cell connectivity. There’s a lot of things going on here: the Iridium modem has a limited queue size, transmissions are not instant, connectivity to the constellation fades in and out, Bluetooth randomly disconnects, etc.

My gut reaction is to slowly build it out. Start with the low-level BLE stuff and build layers on top. Which I did do to shake out the functionality. But before I went and built the whole thing, I stopped and tried to build a TLA+ model of the system. That modelling was only somewhat successful; based on the constraints applied by each part, I discovered that it would be impossible to make the entire system reliable. What the model did, though, was highlight specific failure cases that would need to be detected and reported to the user.

I agree that, in the end, the source code ends up being a detailed and precise specification of what the system does. What I’m realizing more and more though is that putting together more abstract models of the system ahead of time can save a ton of time by forcing you to think through cases that would (in my experience) end up with dirty hacks when they’re discovered after 90% of the code has been written.

It’s not the approach required for every project. I still love firing up a Python or Lisp REPL and hacking away. It’s way more fun! But for certain types of software, it’s very much not the appropriate way to work.

Re:Who builds a house without drawing blueprints? (2015) by hwayne on Thursday June 11, 2020 @12:33PM (#23490560)
> That modelling was only somewhat successful; based on the constraints applied by each part, I discovered that it would be impossible to make the entire system reliable.

"I discovered I can't satisfy all my requirements at once and need to plan my tradeoffs in advance" sounds like a pretty successful modeling result to me!

Re:Who builds a house without drawing blueprints? (2015) by tonyarkles on Thursday June 11, 2020 @08:43PM (#23494799)
You're right :). I sometimes look at that modelling exercise with disappointment; not because I didn't get any value out of it (I got a ton), but because I'm not yet good enough at TLA+ to have been able to successfully write a model that handled all the edge cases.
Re:Who builds a house without drawing blueprints? (2015) by RealityVoid on Thursday June 11, 2020 @03:51PM (#23492689)
I like this reply, but my instinct is to ask, would you not have found out the same thing by doing the implementation? This is the first time I hear about TLA+ and I don't know how difficult it is to work with. Was it easier than doing the thing? It does sound interesting though. But I assume that there is quite a curve to learning something like it.

And, my nitpicky self also says "but that's modeling! Surely, architecture and modelling is not the same thing!". But again, my lack of insight might lead me astray.

I do agree, a little bit of thought beforehand is very useful. Usually, I do this by doing a sketch on paper beforehand, if the mental map is not clear enough, maybe do some simple flow chart that describes the core functionality, just to make sure I understand it well enough.

Re:Who builds a house without drawing blueprints? (2015) by hwayne on Thursday June 11, 2020 @07:45PM (#23494412)
I wrote this case study on using TLA+ for a business project: https://medium.com/espark-engineering-blog/formal-methods-in.... This was a system we'd already spent a lot of time working on and consistently saw a direct correlation between making changes and new production fires. TLA+ caught issues with the planned changes before we actually implemented them.
Re:Who builds a house without drawing blueprints? (2015) by tonyarkles on Thursday June 11, 2020 @08:41PM (#23494791)
And I would like to thank you for the material you've written. You, personally, played a huge role in my choice to look into and eventually standardize on TLA+ as my "distributed systems modelling" tool as well as getting me going on it. You rock, thank you!
Re:Who builds a house without drawing blueprints? (2015) by tonyarkles on Thursday June 11, 2020 @08:40PM (#23494781)
> "would you not have found out the same thing by doing the implementation?"

Yes, although there's a couple of important points to that:

- A lot of it wouldn't have been discovered until late into the implementation. The project itself looked straightforward, and my estimates would have been brutally off if I hadn't done the modelling exercise ahead of time.

- Some of it would likely not have been discovered until after the app shipped. Rare edge cases. To give you context, it's an Android app that talks to an Iridium (satellite) modem over BLE. I basically modelled an abstract Android Activity lifecycle with extra events for user actions, a BLE stack (both sides of the connection), the Iridium connection, and the server on the other side of it. Each of these state machines were relatively straightforward to model. The insight came from letting TLA+ find paths through the five parallel state machines that got me into a weird state. (For an easy example, we make a request that successfully makes it out the Iridium modem to the server, the server replies, the response is delivered to the modem, and there's a corrupt BLE packet that terminates the connection.)

- You're right, architecture and modelling are different things. My flow is basically: 1) high-level requirements, 2) model of the system based on the HLRs, 3) low-level requirements derived from the HLRs and the insight gained from modelling, 4) architecture derived from 1,2,3.

- The amount of thought I'm going to put into a project ahead of time depends drastically on the project. The Iridium/BLE project? On the safety spectrum of 1 (mobile game) to 10 (flight critical software for a commercial jet), that project was about a 6-7. The software didn't have the ability to kill someone, but if it failed in the wrong way, they might believe someone was coming to rescue them when no one was coming.

Re:Who builds a house without drawing blueprints? (2015) by hwayne on Thursday June 11, 2020 @12:24PM (#23490456)
Which blueprint? Engineers I talked to often mentioned that they'd make several different blueprints and different layers of detail. Is code the "high level" or the "low level" blueprints?
Re:Who builds a house without drawing blueprints? (2015) by forgotmypw17 on Thursday June 11, 2020 @06:30AM (#23487266)
I think a blueprint is more like the source code, and a building is more like an instance of the software running in memory.
Re:Who builds a house without drawing blueprints? (2015) by adrianN on Thursday June 11, 2020 @06:42AM (#23487337)
Even that comparison is bad, because a large part of the problems you might have with a house are not because of a bad blue print, but because it wasn't built properly.
Re:Who builds a house without drawing blueprints? (2015) by Retric on Thursday June 11, 2020 @07:10AM (#23487528)
Bad construction errors are almost entirely an issue of bad design. The more complex the roof line, the more likely you are to have leaks. Using multiple types of cladding is similarly inviting a host of issues. etc etc

There is still plenty of room to mess up the details, but that tends to be easier to ignore and cheaper to fix.

Re:Who builds a house without drawing blueprints? (2015) by lucideer on Thursday June 11, 2020 @06:42AM (#23487342)
I agree that analogies and metaphors are always inaccurate and always misleading. And often pointless.

But:

> You don’t generally consider how a house will evolve over time. A house has a limited number of possible states

I don't believe either of these are true

> and a trivially low number of entrances and exits.

and I believe good software should strive to have a similarly low number

Obviously I'm nitpicking, but I don't believe buildings are necessarily worse than other terrible software analogies.

Re:Who builds a house without drawing blueprints? (2015) by doctor_eval on Thursday June 11, 2020 @06:47AM (#23487389)
My point is really that we don’t use analogies to design houses and I think we should stop using analogies to design software.

To your first point, I’ve built a couple of houses, and I’ve never had to worry about how they would evolve or be modified by others after they were built.

Re:Who builds a house without drawing blueprints? (2015) by lucideer on Thursday June 11, 2020 @07:07AM (#23487516)
As someone who's known a fair few architects, we unfortunately do use analogies to design houses. Sadly.

Glad to hear you don't when designing yours though.

> I’ve never had to worry about how they would evolve or be modified by others after they were built.

That seems unfortunate. Isn't that something you should want to consider (though you describe it as an undesirable, which seems a shortsighted view of the purpose of buildings).

Re:Who builds a house without drawing blueprints? (2015) by imtringued on Thursday June 11, 2020 @08:28AM (#23488070)
How would you remove the third floor of a 5 story building? I'm sure its possible.
Re:Who builds a house without drawing blueprints? (2015) by lucideer on Thursday June 11, 2020 @09:32AM (#23488661)
It's probably possible, but I'd say it might be slightly easier to remove the 5th floor. After which the 3rd & 4th could be.. you know.. evolved.

I've also more often seen space in buildings moved horizontally rather than vertically.

Re:Who builds a house without drawing blueprints? (2015) by jp57 on Thursday June 11, 2020 @08:07AM (#23487924)
Yes, building analogies are terrible for coding. A much better analogy is writing.

Writing code a lot like writing. You do it by typing documents in an editor. You revise them. You might have a written outline first, just an outline in your head, or none at all. Revision is important. Before you publish, it is very helpful to have a few smart people you trust read your work over and tell you what's wrong with it, etc.

Re:Who builds a house without drawing blueprints? (2015) by hwayne on Thursday June 11, 2020 @12:22PM (#23490427)
I've interviewed a bunch of people who used to professionally design buildings and now professionally write software. They have a lot more in common than you think.
Re:Who builds a house without drawing blueprints? (2015) by mbrodersen on Friday June 12, 2020 @08:45AM (#23498643)
That's interesting. Can you elaborate on where the similarities are? Thanks
Re:Who builds a house without drawing blueprints? (2015) by cam_l on Thursday June 11, 2020 @07:24AM (#23487635)
Your phrasing suggests a comparison between 1. a finished building and 2. the process of making a piece of software.. of course there is no comparison.

If you look at a more apples to apples comparison, ie. designing (and in that I would include designing the process of building) a bespoke building. Designing a building is about structuring a building process, a business process, a living process, a manufacturing process, or public interface, a place of work, or life, or learning or wonder, all within or about the confines of a building.

Even simple bespoke buildings bring together hundreds of thousands or even millions of parts which have never been put together in this way or by these particular people before. You have to consider how all these materials fit together, behave together, how they degrade over time, their warranties, their performance, how they will get removed, replaced, disposed of. You have to consider how buildings will be modified, or inhabited or changed over time (because if you can't change it, it will be knocked down).

You have to account for the wildly differing preferences for taste, or comfort, or usage of buildings which your clients cannot describe and often have no awareness of. Your client is sometimes the end user, but most end users are not clients. You have no control over any of the important decision making processes, but lots of control over the unimportant ones. All of your attempts to standardise the process in order to contain timeframes result in an incremental lessening of quality or usefulness - sometimes to the effect that the finished product horribly underserves the end users (you often make the clients happy though). Clients also sometimes just refuse to pay.

Architects have been thinking about and writing about and experimenting with information gathering, processing and dissemination for (at least) hundreds of years. I mean, architects were knowledge workers before we even had paper to draw the blueprints on. Much of the early systems of standardisation and automation were driven by architecture (and fashion surely). Hell, the first 3D scanning of an object, a statue, was in the 15thC by an architect.[0] We have been using ticket systems ( rfis), bug reports (post occupation evaluation) and version control systems (transmittals and revisions) for longer than the software industry has been around. The reason for all the arcane processes in the industry is to try to capture, use and re-use information. To standardise processes across consultants, builders, clients, and manufacturers. Most architects are shit, we developed horrible hiring procedures to weed out the shit ones, that don't really work. They chronically underpay staff. They have missed just as many deadlines, and spent just as much money in cost blowouts as the software industry.

No. Designing buildings is almost exactly like designing software. It is just data processing and prediction after all.. and bullshit. Everything new is old. You can probably learn from their mistakes.

[0] https://www.smithsonianmag.com/arts-culture/digital-files-an...

Re:Who builds a house without drawing blueprints? (2015) by doctor_eval on Thursday June 11, 2020 @05:55PM (#23493690)
I have huge respect for architects and civil engineers - and most other professions - and my comments are not meant to suggest that there’s nothing to learn from them. But software is not the same as buildings and we shouldn’t get too invested in the analogy.

Ultimately, most buildings get to a point where they are finished. Tenants move in and the building will stay structurally identical for At least the next 10 years. But a huge amount of software never gets to that point. There’s always a “next release”. Some releases change the structure of the software to fit in concepts that weren’t even considered when the original was built.

For some time now I’ve been using the phrase “software is more like a public garden than a building”. Gardens grow and evolve over time; gardens can quickly and easily be modified for different uses; there are complex dynamic interactions between the parts; users have broad latitude to do unexpected things with them; they even have bugs! (some of which occur long after it’s finished). To me, designing the first iteration of a software system is only one part of the problem. The real challenge is maintaining the “architecture” in the face of long term change. I’ve been wondering if software engineering is more like permaculture than architecture.

The problems in software come from the places where it’s different from anything else. So maybe I’m wrong to say that the building analogy is flawed. Perhaps it’s more accurate to say that it’s not a deep enough analogy to make a meaningful impact on software engineering.

Re:Who builds a house without drawing blueprints? (2015) by cam_l on Saturday June 20, 2020 @09:51PM (#23589051)
Sorry, never saw your response. Agree, and often argue that architects should pay more attention to the fastpaced and generative lessons of software languages, processes and businesses. We should see architecture as less finished, because it rarely is. It always changes, it degrades, the business changes, the family changes, the city changes around it, it breaks it gets extended or fitout or rebuilt, and architects are only sometimes involved (rarely the same architects).

But just because architecture is slower (much slower), it doesn't mean it doesn't contain many of the same issues and challenges. But architecture as a process, the challenges of clients, user interface, communication in building or use, business interface, cost and time control, and not least the incremental effect of degradation and specialisation disintegrating the profession etc.. these have been well documented in our profession and are being experienced anew in software.

I love the garden analogy, architecture should also be more like gardens! We have this misunderstanding that architecture is permanent, but really it is just slow. Trees are nice, but we also need perennials and vegetables.. and mulch.