News for hackers. Stuff that matters.
Re:Yes Silver Bullet (2019) by pron on Friday January 24, 2020 @09:18AM (#22138439)
Here's the problem, though. Brooks made a certain observation about accidental vs. essential complexity; the author of this post makes another. Brooks made a certain prediction based on his observation (diminishing returns in impact to productivity), and many believers in the power of programming languages found his prediction to be too pessimistic at the time (he lists their objections in "No Silver Bullet, Refired"). Only it turned out that his prediction was correct, except it was too optimistic. So if anyone wants to claim that his observation was wrong, they would need to explain why his prediction turned out to be true, while that of those who believed it was wrong turned out false.

In addition, I agree with the author that the biggest contributions to productivity we have seen were, in this order, the availability of open-source libraries and online forums, automated testing, and garbage collection -- all of which have been adopted at rates we'd expect from adaptive traits in an environment with selective pressure. What is conspicuously missing is linguistic features, also in line with Brooks's observation. And yet the author still claims that linguistic features are the silver bullet. At this point this qualifies as an extraordinary claim that requires extraordinary evidence, but I would settle for ordinary evidence, which is also lacking -- strange, considering that a silver bullet, i.e. something with an extreme bottom-line impact, should be easily observable.

Re:Yes Silver Bullet (2019) by Certhas on Friday January 24, 2020 @10:11AM (#22138882)
In your first paragraph you say that Brooks was right in his prediction. In your second you say you agree with the author that "open-source libraries and online forums, automated testing, and garbage collection" were the biggest gains. But those first two were the counter-examples to Brooks according to the author.

So where do you actually disagree with the author? You don't think the gains from these were substantial enough?

Also the author makes a clear argument for why functional programming is, from a complexity perspective, something entirely different from mere "linguistic features". And a "silver bullet" according to Brooks is something that might take a decade to show full impact.

Re:Yes Silver Bullet (2019) by pron on Friday January 24, 2020 @12:55PM (#22140696)
> But those first two were the counter-examples to Brooks according to the author.

They are not.

> So where do you actually disagree with the author? You don't think the gains from these were substantial enough?

I think that 1. the collective gains might have been substantial but not 10x, and 2. the very ideas proposed by the author as being a silver bullet are not even among those in the first group.

> Also the author makes a clear argument for why functional programming is, from a complexity perspective, something entirely different from mere "linguistic features". And a "silver bullet" according to Brooks is something that might take a decade to show full impact.

When I was in university, Haskell was all the rage. People were saying how in some years we'll all be programming in it or in a similar language. That was in 1998 or 1999. Functional programming in general has been well known, and taught for many decades. I'm not saying it's particularly bad, and maybe it could even have a small positive effect, but saying it's a 10x silver bullet at this point sounds delusional. If Brooks was wrong and there is a silver bullet, I very much doubt it's something we've known about, and tried again and again, in various forms, for decades.

Re:Yes Silver Bullet (2019) by alasdair_ on Friday January 24, 2020 @01:24PM (#22141011)
Brooks defines a silver bullet as having a more than 10X productivity gain.

None of "open-source libraries and online forums, automated testing, and garbage collection" have led to a documented 10X improvement in productivity by themselves, so they are not silver bullets.

Re:Yes Silver Bullet (2019) by marcosdumay on Friday January 24, 2020 @11:11AM (#22139464)
A silver bullet can not be something that is itself on the same order of complexity and labor demand that the code it is helping. Those are just a ton of lead bullets, and Brooks does have different predictions for those ones.
Re:Yes Silver Bullet (2019) by Cladode on Friday January 24, 2020 @01:05PM (#22140815)
We've discussed this before [1], but what I've called the ML-ification of programming languages (static types, type inference, higher order functions, exceptions, ...) has been pervasive. Your own Java has been doing quite a bit of this recently. All major software companies (FB, GOOG, MS) have by now retrofitted types to their dynamically typed legacy languages. Even smaller outfits that are based on dynamically typed legacy languages (e.g. Strip, Dropbox) are retro-fitting typing.

[1] https://news.ycombinator.com/item?id=22068223

Re:Yes Silver Bullet (2019) by pron on Friday January 24, 2020 @01:18PM (#22140953)
> what I've called the ML-ification of programming languages (static types, type inference, higher order functions, exceptions, ...) has been pervasive

It has been popular in some class of languages that directly influence one another, and less popular in others. If you look at the software world in, say, 1995, I think a larger precentage of programming was done in typed languages than today. The question of "to type or not to type" wasn't on anyone's mind because virtually all languages used for serious stuff were typed. In any event, even if there is an MLification in important corners of the industry, it's still nowhere near a silver-bullet level of adoption. There is, I agree, a return to the popularity of typed languages, but it hasn't yet reached the level it was before 2000.

Re:Yes Silver Bullet (2019) by Cladode on Friday January 24, 2020 @03:22PM (#22142067)

   before 2000.
In fairness, the adoption of typed languages in the 1990s was about C/C++, Java, possibly Pascal, Delphi, Ada. None of those languages were built upon ML's innovations (type inference, first-class generics, first class higher-order functions, pattern matching etc). I conjecture that the rise of dynamically typed languages was primarily because the aforementioned typed languages adopted an awkward approach to typing (no inference, subtyping + casting to implement both, ad-hoc polymorphism and generics, or, in the case of C++, generics by compile-time meta-programming which has been awkward in other ways).

So 1990s types were a worst-case scenario: not expressive enough for many practical cases (you had to cast a lot anyway), hence the safety you get from typing was not much, syntactically heavyweight, bad error messages. Pointless trivial type annotations like

   A a = new A(...);
are truly grating, but ubiquitous in the typed languages popular in the 1990s. No wonder people preferred Python ...
Re:Yes Silver Bullet (2019) by iainmerrick on Friday January 24, 2020 @03:33PM (#22142165)
I’m not sure why you start in the 90s; plenty of people were using C and Pascal in the 80s.

Are you sure there was a big rise in dynamic languages at any particular point? I’m not so sure there really was (but I’m interested in documentary evidence if you know of any).

I always figured dynamic languages became more popular as computers got bigger and faster, so efficiency became less important in most scenarios. But that’s not the only trend -- plenty of people programmed in BASIC in the 80s, on tiny 8-bit computers! It was slow as hell, but P-code can be very memory efficient, so even on a tiny slow computer dynamic languages can make sense.

(I count BASIC as dynamic even though it lacks useful abstraction mechanisms because most dialects manage memory for you automatically.)

Edit to add: maybe Forth is a better example (and a much better language!) although I don’t think it was ever as popular as BASIC.

Re:Yes Silver Bullet (2019) by Cladode on Friday January 24, 2020 @03:39PM (#22142212)
Lisp is from the 1950s, dynamically typed and one of the most influential languages of all times. Lisp introduced GC, the single biggest advance in programming languages (but it took 30 years to make it fast). I am not trying to argue that dynamically typed languages became popular in the 1990s.

If anything, I see ML as the (spectacularly) successful attempt at typing Lisp for increasing reliability. Remember Milner was at Stanford in the 1960s, surely he will have conversed with McCarty. Milner's early theorem provers were in Lisp. He invented ML to reduce the pain of using Lisp (remember, ML stands for "meta language"), and to make theorem proving less error prone. More precisely to reduce the TBC (= trusted computing base) in theorem provers through types (viz the famous Thm abstraction).

ML was essentially finished in the late 1980s [1]. Every responsible programming language designer could have taken on board ML's lessons sincen, and it's an interesting historical question why this did not happen.

[1] R. Milner, M. Tofte, R. Harper, The Definition of Standard ML. http://www.lfcs.inf.ed.ac.uk/reports/88/ECS-LFCS-88-62/

Re:Yes Silver Bullet (2019) by iainmerrick on Friday January 24, 2020 @04:17PM (#22142551)
Thanks for that, I wasn’t fully aware of the history of ML! Very interesting (and very impressive that this is just one of Milner’s contributions).

I started with Haskell, where the main influence besides ML was Miranda. (If I remember correctly, Haskell was only created because Miranda was proprietary; similar to BitKeeper and Git.) I guess Miranda’s main innovation was lazy evaluation. That has certainly been influential but outside Haskell I don’t think it’s ever had widespread adoption in the same way as ML-style typing and type inference.

* Every responsible programming language designer could have taken on board ML's lessons sincen, and it's an interesting historical question why this did not happen.*

Agreed! But maybe it is happening, it’s just that it’s taken 30 years instead of the 5 or 10 one might have expected?

Re:Yes Silver Bullet (2019) by Cladode on Friday January 24, 2020 @05:12PM (#22142948)
Yes, Miranda was very expensive, had an onerous license and only ran on Unix, that's why researchers felt the need to create a free and open alternative.

Lazy evaluation was invented multiple times. First in theoretical studies of the lambda calculus by Wadsworth in 1971. Later, Friedman & Wise, and independently Henderson & Morris proposd a lazy Lisp, Turner (who later did Miranda) gave SASL a lazy semantics (SASL was eager initially). All three were from 1976, so it was clearly an idea in-the-air. SASL later evolved in to Miranda. Another of Miranda's innovations was to use combinators for graph reduction to implement the Miranda run-time.

Re:Yes Silver Bullet (2019) by burpsnard on Friday January 24, 2020 @03:35PM (#22142182)
Widget w; // stack

Widget *pw = new Widget(); // heap

Memory is no longer highly constrained

Re:Yes Silver Bullet (2019) by hinkley on Friday January 24, 2020 @05:12PM (#22142953)
Which is double “damning” because plentiful memory means more objects, and often deeper interactions, which means the likelihood of getting object lifetime exactly right declines. Not only does manual management become less necessary, it also becomes less tenable.
Re:Yes Silver Bullet (2019) by iainmerrick on Friday January 24, 2020 @03:20PM (#22142056)
Hmm, I’m not sure you’re right about the historical trends. As I see it, the static typing battle has been going on forever. Each style has been popular in certain areas but neither has ever been completely dominant.

Javascript, Python and Ruby are the big dynamic languages today. But you can go back as far as you like, to when languages like Perl, TCL, Lisp and BASIC were big. There have always been dynamic languages.

Static languages have gotten more robustly type-safe over time (even today’s C is much safer than K&R C). But apart from that shift, it seems to me that the static vs dynamic landscape has been much the same for decades.

Re:Yes Silver Bullet (2019) by rsclient on Friday January 24, 2020 @05:37PM (#22143073)
I'm not sure why you're including BASIC in with the dynamic languages -- in its classic microcomputer form, it's pretty well limited to int or float, and string, and arrays of those things. When you make a variable, you always define it's type (A is a double, but A$ is a string).

Some versions are a little bit richer in that you can have both ints AND doubles (woot, woot!).

Re:Yes Silver Bullet (2019) by coldtea on Friday January 24, 2020 @11:11AM (#22139471)
>So if anyone wants to claim that his observation was wrong, they would need to explain why his prediction turned out to be true

Well, who said his prediction turned out to be true? Who actually measured the "impact to productivity" in any quantifiable terms? And who re-did that measurement after "No Silver Bullet, Refired" (which was 25+ years ago)?

Re:Yes Silver Bullet (2019) by pron on Friday January 24, 2020 @01:23PM (#22141007)
You don't need to carefully measure to know that no single development has led to a 10x boost. As someone who was working on large software since the late 90s, we're building things today at a similar pace, with the exception that there are many more pre-built components we just grab. Can you point to a technique/tool that has led to a 10x boost?
Re:Yes Silver Bullet (2019) by hinkley on Friday January 24, 2020 @05:22PM (#22142992)
Precision is less valuable when the measurement is larger.

The very first piece of software I optimized, I started with “One Mississippi”, moved to a stopwatch app on my PDA, before I ever bothered with instrumentation. Because any idiot can tell 2 seconds from 3, that a boat won’t fit in the garage, or that more than double is way less than ten.

Ironically, if Brooks had said 3x instead of 10x, he might still be right and we’d have invested more in measuring things.

Re:Yes Silver Bullet (2019) by noelwelsh on Friday January 24, 2020 @10:37AM (#22139134)
I would like to see the evidence for any of your claims. As far as I'm aware there is very little evidence for any productivity improvements related to programming practice, mostly due to lack of high quality studies. It's my understanding that CS doesn't really do that kind of study, for a variety of reasons (primarily, I believe, coming from a mathematics not social science culture).
Re:Yes Silver Bullet (2019) by pron on Friday January 24, 2020 @12:33PM (#22140459)
First of all, empirical verification is not only done through studies. Software is not particle physics, but one of the world's large industries, practiced by millions of practitioners every day. Some techniques/methodologies/practices have spread through the industry like wildfire -- the three I mentioned -- which is at least consistent with the hypothesis that they deliver value; so, to the extent that anything has had a positive effect I believe these three are pretty much the only contenders. It is possible that even I am too optimistic, but there is very unlikely at this point that I'm too pessimistic.

Also, the claim that X has not had a large positive effect requires no evidence. It must be assumed true until proven otherwise; that's just the scientific method. The larger the claimed effect and the longer until it is detected -- especially in a selective environment -- the less likely it is real. However, the claim that something has had a big positive bottom-line effect and yet that effect is not detected in a selective environment that is known to have selected beneficial techniques all the time is false with a very high likelihood to the point of being self-contradictory.

Re:Yes Silver Bullet (2019) by bobm_kite9 on Saturday January 25, 2020 @03:51AM (#22145439)
I wrote something similar several years ago: https://riskfirst.org/Silver-Bullets

Even if you aren’t on-board with the ones this article mentions, there are a bunch more in this list.. and it could probably do with a refresh soon

Re:Yes Silver Bullet (2019) by lostmsu on Friday January 24, 2020 @09:36AM (#22138609)
I am sorry, but the first para of your comment does not make sense. You say "believers" found prediction "too pessimistic". And then you say "except" as if they were wrong, but follow it with "it was too pessimistic, not too optimistic".
Re:Yes Silver Bullet (2019) by pron on Friday January 24, 2020 @09:37AM (#22138621)
You're right. Fixed that. Thanks!