News for hackers. Stuff that matters.
Re:DevOps: An idea so good, no one admits they don’t do it by YetAnotherNick on Monday August 29, 2022 @01:29PM (#32640956)
Rapid release has nothing to do with shifting UI. You can have constantly shifting UI even with weekly release.
Re:DevOps: An idea so good, no one admits they don’t do it by vladvasiliu on Monday August 29, 2022 @01:35PM (#32641042)
I presume GP would call a weekly release "rapid", too.

Given the tone of the message, I expect "non rapid" to mean with a much longer time frame, and, most importantly, the release must be controllable by the user.

Re:DevOps: An idea so good, no one admits they don’t do it by JohnFen on Monday August 29, 2022 @01:40PM (#32641103)
Yes, weekly is certainly rapid.
Re:DevOps: An idea so good, no one admits they don’t do it by jen20 on Monday August 29, 2022 @02:20PM (#32641596)
> most importantly, the release must be controllable by the user.

This is pining for a world which no longer exists, because security patches must be applied to anything that matters immediately.

Re:DevOps: An idea so good, no one admits they don’t do it by Silhouette on Monday August 29, 2022 @06:22PM (#32644325)
It is possible to separate security updates and other critical bug fixes from functional/UI changes. At least it is if you're any good at software development at all. The world would be a better place for users if more software developers still did that.

Of course you do need a strategy for maintaining multiple versions of something in that case instead of just forcing the latest version of everything you do on users whether they want it or not. With the lock-in effects of the always-connected web applications of today we all know which option makes more money.

I take some comfort in knowing that eventually most of the developers that force unwanted changes on their users will probably see their market share erode and lose their dominant positions. It's just unfortunate that we have so many quasi-monopolies in both essential and niche software products that it's going to take a long time for that to happen.

Re:DevOps: An idea so good, no one admits they don’t do it by diffeomorphism on Monday August 29, 2022 @04:49PM (#32643374)
That is completely orthogonal and the whole selling point of things like Windows LTSC or Red Hat: Stable foundations with regular security updates but no surprises.
Re:DevOps: An idea so good, no one admits they don’t do it by pdntspa on Monday August 29, 2022 @08:25PM (#32645261)
Why should something like a drawing app, or a music app, or anything else that doesn't need to be online, need this kind of patch schedule?

This world does in fact still exist, this is how most OSS works!

Re:DevOps: An idea so good, no one admits they don’t do it by lazide on Monday August 29, 2022 @02:58PM (#32642067)
There are things called ‘branches’ you know.
Re:DevOps: An idea so good, no one admits they don’t do it by theptip on Monday August 29, 2022 @02:05PM (#32641386)
Yes, was going to post the same reply. Iterative UI, A/B testing, webapp-driven (vs. installed versioned apps) are completely orthogonal to the OP discussion of Continuous Deployment / rapid deployment.

CD is a deploy strategy saying the aspiration is to do one deploy per commit, rather than batching commits and deploying once per N weeks or whatever. It has approximately zero to do with UX and product design/iteration approaches.

Re:DevOps: An idea so good, no one admits they don’t do it by wizofaus on Monday August 29, 2022 @03:10PM (#32642219)
One deploy per commit for a product with large team sounds insane - we'd easily have 50 commits a day for some hosted components. Even deploying this often to the non-prod environments is problematic (it takes a fair bit longer than 1/50th a day for a start!), but doing that to your customer-facing production sites sounds bonkers - what class of problems is there that that's the best way to prevent them?
Re:DevOps: An idea so good, no one admits they don’t do it by theptip on Monday August 29, 2022 @04:22PM (#32643049)
Yes it's aspirational, and of course you have to do batching when the rate of commits gets too high. Many companies don't actually end up at the end of the spectrum with full continuous delivery; most of the value is captured by building what's needed _to be able to_ if you chose to, and doing say daily or hourly automated deploys.

If you're not familiar with the general arguments for why CD might be desirable, a good place to start would be the books Continuous Delivery [https://smile.amazon.com/Continuous-Delivery-Deployment-Auto...] or Accelerate [https://smile.amazon.com/Accelerate-Software-Performing-Tech...]. The TLDR would be that most deploy problems in practice turn out to be because the process is manual, infrequently-used, and/or unreliable, and by practicing "if it hurts, do it more often" you are forced to iron out those kinks. For example you can't deploy automatically without a good acceptance/smoke test suite, and without solid DB migration testing/linting/practices, to name just two of many. You could just build all these things without trying to do CD, but in practice it seems that it's quite hard for organizations to prioritize this work in isolation, and the goal of CD seems to provide a fairly clear map to a much higher-quality deploy process. The practice of deploying more frequently to flush out issues, is also quite unintuitive as you note.

Here's a (probably out-of-date) article on how FB did deploys in 2017: https://www.infoq.com/news/2017/09/facebook-release-scale/ -- batched commits and staged canary rollouts automatically cut and released every few hours.

Re:DevOps: An idea so good, no one admits they don’t do it by wizofaus on Monday August 29, 2022 @04:51PM (#32643390)
Yes I do get the general argument for CD (though I have issues with how universally it can be applied based on the sort of BVT I've had to do for SaaS platforms I worked on in the past, where it just wasn't possible to safely release new versions of key components without needing several days' worth of testing, most of which was waiting for verification that interactions with banks etc. had worked as expected).
Re:DevOps: An idea so good, no one admits they don’t do it by theptip on Tuesday August 30, 2022 @12:56AM (#32646765)
Agreed, like almost everything it’s not universally applicable.

If you have external contracts that are onerous to validate then it can be quite expensive to build high-fidelity internal representations of those contracts. Could still be ROI positive to do so!

In most cases the contracts are either internal or simple (non-temporal) external contracts like a REST API, so most orgs benefit from moving in this direction.

Re:DevOps: An idea so good, no one admits they don’t do it by YetAnotherNick on Monday August 29, 2022 @06:31PM (#32644409)
> customer-facing production sites sounds bonkers

We came from very different lands I guess. Batching 50 commits with no easy way of knowing which commit caused the issue seems scarier to me, in case of an issue. And if you code correctly and have warmup requests, your deployment could be without any downtime. Obviously there will be some extra resource usage because of unready resources.

Re:DevOps: An idea so good, no one admits they don’t do it by wizofaus on Monday August 29, 2022 @06:35PM (#32644435)
But if you're doing 50+ deploys a day, how can there possibly enough time to know which commit caused whatever issue that gets noticed anyway? If those 50 deploys are done during regular business hours that's 9 minutes per deploy on average!
Re:DevOps: An idea so good, no one admits they don’t do it by YetAnotherNick on Monday August 29, 2022 @06:43PM (#32644501)
Reply to wizofaus: 9 minutes is more than much more than enough to revert, at least in our setup. Specially if some automated alert triggers, then we could revert well within a minute.
Re:DevOps: An idea so good, no one admits they don’t do it by pjerem on Monday August 29, 2022 @10:32PM (#32646011)
That’s what staging environments are for : deploying every commit to check everything is fine, doing the QA and get the alerts.

Doing this in production is being disrespectful of your users. Users are not waiting for your PRs to be approved and merged, they can be as delighted by your new button’s shade of lightgrey if it is released some days (even weeks !) after.

Re:DevOps: An idea so good, no one admits they don’t do it by wizofaus on Tuesday August 30, 2022 @08:35AM (#32649574)
That's my feeling, that you get all the benefits of rapid/frequent deployment by doing so to non-production environments, and deploy to production when you have a good reason to do so. But either way I don't really understand being driven by a desire to ensure every commit results in a deploy. It boggles my mind that a complex product, especially involving mobile platforms, could be fully built, ci-tested, deployed then e2e tested within 10 minutes, even with a massive array of distributed computing power. Mostly due to 3rd party tools that give you no choice but to wait 20 minutes or more for certain steps to complete. I'm intrigued to know how it's done.
Re:DevOps: An idea so good, no one admits they don’t do it by wizofaus on Monday August 29, 2022 @06:57PM (#32644618)
I can't even begin to think how to get there, at least using CloudFormation.
Re:DevOps: An idea so good, no one admits they don’t do it by theptip on Tuesday August 30, 2022 @12:59AM (#32646779)
More advanced/modern tool chains like k8s can help; rollout can be done in minutes. Also makes it easier to do blue/green deploys if you’re serving high throughput services where you can get an error signal from upgrading a small fraction of your service workloads.
Re:DevOps: An idea so good, no one admits they don’t do it by JohnFen on Monday August 29, 2022 @05:28PM (#32643805)
> It has approximately zero to do with UX and product design/iteration approaches.

The connection is that if the commit changes how the product works in a way noticeable to the user, then the user must suffer the changes frequently. Since changes incur a cost to the user, it's requiring the user to constantly be paying those costs.

If the deployment happened less frequently, then the user would incur the cost less frequently, and perhaps in a way they could schedule when to take the change on so it is the least disruptive to them.

Re:DevOps: An idea so good, no one admits they don’t do it by bluGill on Monday August 29, 2022 @02:08PM (#32641428)
I've worked with software that has to work. Our customers put it in a lab where they beat on it in simulation for 3 more, months - any bugs and they stuck with the old version. (which is one reason land lines were so reliable in the 1990s) We did a code freeze 6 months before release in hopes of catching everything.

Most software nobody cares if it works or even is possible for untrained humans to use, and it shows.

Re:DevOps: An idea so good, no one admits they don’t do it by morelisp on Monday August 29, 2022 @02:13PM (#32641488)
The glut of isolated B2C SaaS products/developers has absolutely destroyed any communal valuation of “known issues.” True in-house heads still remember.