News for hackers. Stuff that matters.
Re:Long term support considered harmful by chollida1 on Tuesday January 27, 2015 @02:42PM (#8955214)
> A one year support window isn’t too short; it’s too long.

Wow, I'm in very strong disagreement with the author on this point.

I don't think I could find a single person, technical or otherwise who didn't use the same operating system for more than a year. In fact its the default for almost everyone who isn't technically inclined to upgrade their os only when they get a new computer.

What about every single car produced today. I doubt you'd want to upgrade them every 6 months.

As a ubuntu user, I find that I cross my fingers every time I run sudo apt-get upgrade. About half the time I get broken builds and once a year my OS will just flat out crash from it, or fail to reboot in virtual box.

This view, while idealistic is just so laughable I can't begin to believe the author is serious.

I've worked with some mission critical systems( stock exchange's) They take more than a year planning a big OS upgrade. To turn around and tell them that they should be doing this every 6 months is just so out of touch with reality, I don't know how to respond to the author:(

Many companies won't install a new piece of software until its been proved out in production for 6 months to a year by someone else....

Re:Long term support considered harmful by lomnakkus on Tuesday January 27, 2015 @02:59PM (#8955339)
From a different perspective...

... perhaps if we were to actually get serious about doing small/incremental updates all the time, we'd get better at actually doing them without incident.

I think one of the major obstactles is that the software stack has become ridiculously (and hideously) complex over time. If we could converge towards a world more like what's described here[1], then I think we'd be in a better place overall. (Granted, this the video is talking about deploying services, but AFAICT there's little essential difference between that and a modern GUI system with all its DBUS interfaces and whatnot.)

[1] https://www.youtube.com/watch?v=GaHzdqFithc

Re:Long term support considered harmful by vinceguidry on Tuesday January 27, 2015 @03:27PM (#8955568)
Small, incremental upgrades are something I'm finding are essential to maintaining sanity as the only dev at my company doing what I do. Waiting to upgrade only increases the pain. Now instead of having one potential issue to troubleshoot every now and again, I have dozens when I finally do buck up and upgrade.

So I get in the habit of upgrading the dependencies of all the apps I work on, every time I work on them. Issues happen, but only to one dependency at a time. It's manageable.

What I would love is to eventually have a CI server do it for me. Every single day, it would run bundle update, run the tests, and deploy unless there's a problem. If there is a problem, it drops me an email with the trace and fixing it becomes part of my morning routine.

If subtler problems surface this way, then I've discovered an oversight in my test coverage, or an overly complicated architecture that I need to remove dependencies from.

I'll probably implement this sometime this year. I'm thinking I'll want to redo deployment instead of relying on Capistrano, then finally growing my own CI solution. I'm slowly moving away from big monolithic apps to smaller, homegrown solutions that do only what I want them to do. I've already reimplemented provisioning and configuration management. I believe in DevOps as code.

Re:Long term support considered harmful by sarciszewski on Tuesday January 27, 2015 @03:39PM (#8955661)
> What I would love is to eventually have a CI server do it for me. Every single day, it would run bundle update, run the tests, and deploy unless there's a problem. If there is a problem, it drops me an email with the trace and fixing it becomes part of my morning routine.

Agreed. A while back, there was a security fix in the default php5-fpm configuration (0666 -> 0660, I believe), and I skipped it when updating. My website went down until I learned to change the owner of the process. And this wasn't even a dist-upgrade.

Sometimes manual intervention is required.

In my case, I run updates almost every day. If I had to wade through 6 months of backlogged updates, I would have wasted a lot more time identifying where it broke. Smaller feedback loops are a win.

Re:Long term support considered harmful by pfg on Tuesday January 27, 2015 @03:42PM (#8955688)
Gemnasium provides something similar to what you describe in the context of Ruby applications with Gemfiles. It can be configured to automatically generate pull requests updating outdated dependencies, which could trigger your test suite to automatically check for regressions.
Re:Long term support considered harmful by steveklabnik on Tuesday January 27, 2015 @04:12PM (#8955942)
I use Travis CI to maintain my Ruby gems, and one thing that I do is turn on a build that allows failure, where it uses the HEAD version of my upstream dependencies. That way I know within a day when upstream has done something broken, which is especially nice if it's by accident.
Re:Long term support considered harmful by Sanddancer on Tuesday January 27, 2015 @03:42PM (#8955695)
The problem is that OpenBSD has had some pretty significant user-facing changes in only the past year. The past few releases have seen apache replaced with nginx, and the next version is going to be getting rid of nginx for their own httpd. If you're just using the basic webserver, that's some pretty significant change right there. While they're advertising clean and simple, they can and do introduce potentials for heavy breakage in nearly every release.
Re:Long term support considered harmful by lomnakkus on Tuesday January 27, 2015 @04:53PM (#8956258)
Maybe that's an indication that the configuration of the web server should be partitioned into "basic configuration" (which they can all support) and a few other categories (which are supported by a subset), i.e. the configuration itself should be "standardized".

I realize that this is a nontrivial proposition, but if we're ever going to realize the dream of "interchangeable parts" we're going to have to learn to do this stuff.

Re:Long term support considered harmful by JoachimSchipper on Tuesday January 27, 2015 @04:01PM (#8955841)
The old code is one pkg_add away, though. Breaking binary compatibility is at least as likely to hurt you - and simply upgrading PostgreSQL without a dump-reload cycle can hurt plenty.
Re:Long term support considered harmful by Sanddancer on Tuesday January 27, 2015 @04:52PM (#8956251)
That still requires admin time to update the configuration and change management tools, QA time to run a regression test that will exercise all the potential failure paths, development time if you count on the ability to do configuration updates based on application state, etc. Updates that look small can still require considerable changes.
Re:Long term support considered harmful by lstamour on Tuesday January 27, 2015 @06:06PM (#8956774)
If you're used to it, you can streamline these processes and automate as much as possible. Even if it's a change you can't easily test or automate, by making just the one change at a time you know what to blame if it breaks. :)
Re:Long term support considered harmful by dietrichepp on Tuesday January 27, 2015 @03:59PM (#8955828)
Presumably that's just the default web server, and you can use the webserver of your choice as well?
Re:Long term support considered harmful by rodgerd on Tuesday January 27, 2015 @03:23PM (#8955549)
> ... perhaps if were to actually get serious about doing small/incremental updates all the time, we'd get better at actually doing them without incident.

That would require more developers to actually give a fuck about the user experience not breaking from release to release.

Re:Long term support considered harmful by danielweber on Tuesday January 27, 2015 @03:43PM (#8955701)
I simply expect that doing an upgrade of the system (as opposed to grabbing the latest version of applications and libraries) is going to totally destroy my box and I'll spend the day recovering, because that's happened to me multiple times, from multiple OS vendors.
Re:Long term support considered harmful by lomnakkus on Tuesday January 27, 2015 @04:45PM (#8956203)
Hopefully (and I realize that this is somewhat wishful thinking), more users doing haphazard upgrades and complaining about them not working would be feedback into the whole cycle.

(I'm not very well placed in the software cycle to actually start this feedback loop, but one can wish, right?)

Re:Long term support considered harmful by rodgerd on Tuesday January 27, 2015 @08:11PM (#8957408)
Given the general quality of response to user reports in free software ("The source is there, fix it yourself", "WONTFIX", "That's a feature", "you're doing it wrong."
Re:Long term support considered harmful by phunge on Tuesday January 27, 2015 @04:06PM (#8955887)
I've held jobs at both ends of the spectrum, from bleeding-edge to death-by-legacy. There's a good deal of pain with both approaches, that's the reality. Would your org rather deal with security vulnerabilities and no upstream support, or deal with things blowing up once in a while?

What I like about this article is it's talking about what the global optimum is -- what's the best approach for the entire ecosystem? Not just for one individual or one org. What's Pareto optimal? (Or maybe it's a little less general -- what's the best approach for those who depend on FOSS, and don't pay someone like RedHat for long-term support and CYA insurance).

And basically I agree. The world's upgrade cycles could stand to be a whole lot shorter than they are. Every time I think about all the hardware in this world that'll spend its whole lifetime vulnerable to heartbleed, or shellshock, or a gazillion smaller vulns, my skin crawls.

Re:Long term support considered harmful by nathan_long on Tuesday January 27, 2015 @03:36PM (#8955644)
> They take more than a year planning a big OS upgrade.

That sounds painful.

I think the author is really advocating for a faster feedback cycle. Imagine if instead of a big upgrade every X months, you had a tiny upgrade every day, which didn't require rebooting and happened in the background.

Breaking changes could surface the same day they were shipped and be rolled back or fixed.

Now imagine that conservative players also constantly upgrade, but always stay 6 months behind the bleeding edge, getting only releases marked as "tried and true". Eg, if something had to be rolled back or patched, they skip over the bad version.

Wouldn't that make upgrades much less painful for companies like you describe?

Re:Long term support considered harmful by tormeh on Tuesday January 27, 2015 @05:49PM (#8956688)
You do realize he's talking about a stock exchange? Even a millisecond downtime is unacceptable. Some things don't even need backup, others need testing on identical hardware in identical configuration before deployment. That's just the way it is.
Re:Long term support considered harmful by bzbarsky on Tuesday January 27, 2015 @11:57PM (#8958198)
To be fair, it's _unscheduled_ downtime that's not acceptable for a stock exchange. They have scheduled downtimes all the time. For example, as far as I can tell the NYSE is only "up" 9:30am-4pm local time, Monday to Friday, and not on certain holidays.

Now this does mean that you have to make very sure that the upgrade you start at 4pm on Friday will be totally done and bug free by 9:30am on Monday, of course.

And I agree with your larger point that in a situation like that testing done by someone else in a different configuration is of limited (though nonzero) utility.

Re:Long term support considered harmful by nathan_long on Wednesday January 28, 2015 @10:23AM (#8960263)
I understand, and I admit I haven't done anything like that. But isn't it still easier to thoroughly test a day or week's worth of OS changes at a time than to test 6 month's worth or a year's?
Re:Long term support considered harmful by munchhausen on Wednesday January 28, 2015 @08:45AM (#8959726)
> As a ubuntu user, I find that I cross my fingers every time I run sudo apt-get upgrade. About half the time I get broken builds and once a year my OS will just flat out crash from it, or fail to reboot in virtual box.

What I'm about to say has been said a thousand times, but I guess we need to keep saying it as long as this myth survives. Are you using PPAs? Are you using PPAs that provide newer versions of software that also ships with the system? Are you using third-party drivers (looking at you, Nvidia)? If so, there's your problem. It's not that difficult to blast away your PPAs with "ppa-purge" prior to running a distribution upgrade. As for regular package updates - "apt-get upgrade" won't break a system, that's not been already severely broken by the user. Period.

I use Ubuntu on the desktop and the server, and have done many upgrades over many versions. I don't recall a post-upgrade broken system in recent years that wasn't due to third-party stuff. Even then, it's trivial to fix - reboot to recovery mode if you can't get your X11 on, "apt-get purge" the offending stuff, reboot and carry on.

My impression is that Ubuntu screwed up on a major version upgrade several years ago, and their upgrade process is still being dinged by folks due to the wave of bad publicity that that incident created. Which is a shame, because Ubuntu post 12.04 is a rock-solid operating system that is a joy to use (upgrading included). Granted, third-party packages can sometimes reduce the overall stability, but then what do you expect? It helps to carefully vet which PPAs you use - PPAs that are done by people who know what they're doing don't tend to cause trouble.

If you want a rock-solid system, do a clean install of an LTS release, don't set up PPAs, and enjoy. I have a side Thinkpad with 12.04 on it which is exactly that, and it's the most stable system I've ever used. And it's being kept current with security patches and bugfixes with regular "apt-get upgrade".

Re:Long term support considered harmful by jkot on Tuesday January 27, 2015 @03:37PM (#8955651)
I know group who does REBOOT once year, just not to forget how it is done.
Re:Long term support considered harmful by nailer on Tuesday January 27, 2015 @05:58PM (#8956740)
I appreciate what you're saying, but your seem to not be addressing the point of the post: you could reduce risk by moving to rolling upgrades. A year of changes is a big change, smaller updates are not. There's also a huge risk in stasis.

Not that it's relevant, but to respond to your first point: you know people who roll their browser, and a few Linux distros roll their release too. I've heard of some startups who use a Fedora rather than CentOS for that reason.

[deleted]
Re:Long term support considered harmful by zokier on Tuesday January 27, 2015 @02:58PM (#8955333)
> That's what you need to do when OS releases are made only once every few years and are big. They don't have to be that way

Ubuntu and Fedora releases happen already in 6 month cycles. This is not some novel unexplored concept.

Re:Long term support considered harmful by wtallis on Tuesday January 27, 2015 @03:45PM (#8955712)
Ubuntu and Fedora are aggressive about incorporating new stuff. It's possible to have the same release cadence while operating with a more Debian-like attitude toward stability.
Re:Long term support considered harmful by taeric on Tuesday January 27, 2015 @03:00PM (#8955357)
I question the scale of just what is getting upgraded if it is "quick and painless."

Note, that I do not mean to diminish the accomplishment. Especially as a fan of TeX and someone that often toutes that maybe we are learning the wrong software lessons by constantly rewriting everything to be in the latest safe language/paradigm.

However, to not acknowledge all of the progress that is made in other areas is just as dangerous as not acknowledging the benefits of more deliberate methodologies.

Re:Long term support considered harmful by sliverstorm on Tuesday January 27, 2015 @03:16PM (#8955488)
Last I used it, OpenBSD did a good job of compartmentalization. Like your cell phone or tablet, upgrades could be freely burn-the-earth-boil-the-seas, because user data and configuration was well-separated from the system files. Additionally updates were delivered in complete tarball form- you didn't upgrade eighty packages, you just unzipped one complete tarball.

It probably helped that the complexity was low- I remember the default install occupying some 300MB of disk and a few tens of MB of memory, in a time when Ubuntu already occupied some 10GB.

That was more than half a decade ago though.

Re:Long term support considered harmful by taeric on Tuesday January 27, 2015 @03:51PM (#8955774)
I question the comparison to cell phones and tablets. In those, upgrades have become painless because I do not value any data on them. That is, there is zero data that I would miss if I completely lost my tablet.

This works because I quit caring about the UI experience. I accept that when I upgrade, things will be dramatically different.

If I adopt a similar policy on my computer, I get similar results. However, as soon as I start actually caring about more and more data on the machine, things get tricky.

And this is where a lot of customizable user interfaces hit ridiculous trouble. Those customizations are rarely treated as important data. Worse, there is often a lack of ability to clean up excess preferences.

Which leads me back to my main point. There have been a lot of advances in consumer user applications that are easy to ignore in server applications. Which makes upgrading much more difficult in the consumer space.

Re:Long term support considered harmful by sliverstorm on Tuesday January 27, 2015 @03:56PM (#8955819)
I mostly made the comparison because my Android phone is partitioned similarly to how I remember the recommended scheme in 4.2-4.4 OpenBSD, and in both cases that partitioning scheme lends itself very strongly to painless upgrades.

But you are right about the lower "data risk" on phones, thanks to cloud services and such.

Re:Long term support considered harmful by taeric on Tuesday January 27, 2015 @08:00PM (#8957360)
Is a fair point. But I think that we keep far less data on these devices than you ever did on a computer. Certainly not in the size of the data, but more in the types. Preference and general settings data has basically erased on these.
Re:Long term support considered harmful by pekk on Tuesday January 27, 2015 @04:06PM (#8955882)
You find the author's view laughable, but I find your view laughable. Reasonable deployments of Ubuntu or Windows get upgraded with security fixes all the time, browsers update themselves all the time. Waiting a year between security fixes is just foolish.
Re:Long term support considered harmful by Silhouette on Tuesday January 27, 2015 @04:45PM (#8956206)
The problem isn't the security fixes. Everyone agrees that pushing security fixes promptly is generally a good idea. The problem is all the other changes that you may or may not want that get bundled in with those security fixes in a forced-upgrade model. Certain web browsers are among the best examples I know of this user-hostile behaviour.
Re:Long term support considered harmful by abraham on Tuesday January 27, 2015 @06:14PM (#8956828)
The entire point of the article is that "all the other changes" include security fixes nobody knows about.
Re:Long term support considered harmful by anon1385 on Wednesday January 28, 2015 @08:08AM (#8959544)
They also include new security flaws nobody knows about.
Re:Long term support considered harmful by PeterisP on Tuesday February 03, 2015 @02:21AM (#8989275)
> What about every single car produced today. I doubt you'd want to upgrade them every 6 months.

Tesla cars get automated over-the-air updates far more frequently than every 6 months.

Re:Long term support considered harmful by jms703 on Tuesday January 27, 2015 @06:30PM (#8956915)
> I don't think I could find a single person, technical or otherwise who didn't use the same operating system for more than a year.

You can. Think AWS systems (as an example) where you don't log in and patch, you spin up a new instance instead. This can't apply to everything (stock exchanges, MRIs, etc), but for the software affected by glibc, absolutely.

Re:Long term support considered harmful by stonemetal on Tuesday January 27, 2015 @04:59PM (#8956304)
In fact its the default for almost everyone who isn't technically inclined to upgrade their os only when they get a new computer.

Most new computers come with a warranty that is 90 days. Why should software support be 5x longer?

Re:Long term support considered harmful by viraptor on Tuesday January 27, 2015 @05:20PM (#8956470)
Depends on the country. In most places in Europe that would be 2y minimum.
Re:Long term support considered harmful by Silhouette on Tuesday January 27, 2015 @05:20PM (#8956467)
Most new computers come with a warranty that is 90 days.

Where? In the UK, consumer protection laws would probably force a minimum of two years in most cases. Even after that, if an expensive device mysteriously failed on day 2x365+1 in a way that wasn't reasonably expected, the purchaser would still have some relevant rights.

Why should software support be 5x longer?

It is all about reasonable expectations. No-one paying for basic system software would reasonably expect it to stop working after three months.

Of course if we're talking about Open Source software that you're getting for free then it's your own responsibility to make sure it does the job you need and no-one owes you anything. This is part of the reason that selling support for otherwise free software is a viable, and sometimes highly lucrative, business model.

Re:Long term support considered harmful by stonemetal on Tuesday January 27, 2015 @06:13PM (#8956820)
US, Canada, Mexico. While no one expects hardware or software to stop working after three months supporting it forever isn't really worth it either.
Re:Long term support considered harmful by PhasmaFelis on Tuesday January 27, 2015 @08:12PM (#8957412)
Because hardware warranties and software support have completely different purposes? Seriously, this is a non sequitur.