News for hackers. Stuff that matters.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by mmrezaie on Wednesday December 16, 2020 @01:36PM (#25446407)
I am really interested to know why should anyone go with this when Debian or Ubuntu LTS exist. The two later have not changed their policies in the last decade, and they have a clear path for upgrading. CentOS was always a clear choice for device drivers support, but I never understood the stability claims.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by StillBored on Wednesday December 16, 2020 @04:32PM (#25449008)
RHEL and its derivatives are the only linux distribution which maintains binary compatibility over 10+ years while getting not only security updates but feature additions when possible.

This is something I don't think the wider community understands, nor do they understand the incredible amount of work it takes to back-port major kernel/etc features while maintaining a stable kernel ABI as well as userspace ABI. Every single other distribution stops providing feature updates within a year or two. So LTS, really means "old with a few security updates" while RHEL means, will run efficiently on your hardware (including newer than the distro) with the same binary drivers and packages from 3rd party sources for the entire lifespan.

AKA, its more a windows model than a traditional linux distro in that it allows hardware vendors to ship binary drivers, and software vendors to ship binary packages. That is a huge part of why its the most commonly supported distro for engineering tool chains, and a long list of other commercial hardware and software.

Re:Rocky Linux: A CentOS replacement by the CentOS founder by acdha on Wednesday December 16, 2020 @06:24PM (#25450170)
That's the value pitch for RHEL, where it's understandable — whether or not you like the enterprise IT model of avoiding upgrades as long as possible, there's a ton of money in it.

I think the gap is the question of how many people there are who want enterprise-style lifetimes but don't actually want support. If you're running servers which don't need a paid support contract, upgrading Debian every 5 years is hardly a significant burden (and balanced by not having to routinely backport packages). There's some benefit to, say, being able to develop skills an employer is looking for but that's not a huge pool of users.

I think this is the reason behind the present situation: CentOS' main appeal was to people who don't want to pay for RHEL, and not enough of those people contribute to support a community. That lead to the sale to Red Hat in the first place and it's unclear to me that anyone else could be more successful with the same pitch.

Re:Rocky Linux: A CentOS replacement by the CentOS founder by ghaff on Wednesday December 16, 2020 @07:22PM (#25450680)
>who want enterprise-style lifetimes but don't actually want support

But lifetimes are support. Support isn't just, or even primarily, about making a phone call and saying "Help, it's broken." After all, there's nothing keeping someone from taking a snapshot of a codebase and running it unchanged for 10 years. Probably not a good idea if you're connected to the network, but certainly possible.

Re:Rocky Linux: A CentOS replacement by the CentOS founder by acdha on Wednesday December 16, 2020 @09:11PM (#25451549)
I was thinking more about _why_ people want that. If you're changing the system regularly, upgrading is valuable because you don't want to spend your time dealing with old software or backporting newer versions. Most of the scenarios where you do want that are long-term commercial operations where you need to deal with requirements for software which isn't provided by the distribution, and in those cases they likely do want a support contract.

I'm not sure there are enough people left who have the “don't touch it for a decade” mindset, aren't working in a business environment where they're buying RHEL/SuSE/Amazon Linux/etc. anyway, and are actually going to contribute to the community. 100% of the people I know who used it were doing so because they needed to support RHEL systems but wanted to avoid paying for licenses on every server and they weren't exactly jumping to help the upstream.

Red Hat bought CentOS in the first place because they were having trouble attracting volunteer labor and I think that any successor needs to have a good story for why the same dynamic won't repeat a second time.

Re:Rocky Linux: A CentOS replacement by the CentOS founder by ghaff on Thursday December 17, 2020 @08:57AM (#25455575)
>I was thinking more about _why_ people want that.

I think there are two primary reasons.

1.) A developer wants to develop/test against an x.y release that only changes minimally (major bug and security fixes) for an extended period of time.

2.) The point release model where you can decide when/if to install upgrades is just "how we've always done things" and a lot of people just aren't comfortable with changing that (even if they effectively already have with any software in public clouds or SaaS).

I largely agree with your other points.

Re:Rocky Linux: A CentOS replacement by the CentOS founder by acdha on Thursday December 17, 2020 @03:09PM (#25459750)
Re: point 2, I don't know how different that is for stable distributions — e.g. if you're running Debian stable you're in control of upgrades and you can go years without installing anything other than security updates if you want.

Re: point 1, I'm definitely aware of that need but the only cases I see it are commercial settings where people have contractual obligations for either software they're shipping or for supported software they've licensed. In those cases, I question whether saving the equivalent of one billable hour per year is worth not being able to say “We test on exactly the same OS it runs on”.

Re:Rocky Linux: A CentOS replacement by the CentOS founder by stjohnswarts on Thursday December 17, 2020 @11:18AM (#25456948)
Have you worked in banking or aerospace? 10 years of needed support/stability/predictability is nothing unusual. The old if it ain't broke don't fix it mindset prevails.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by acdha on Thursday December 17, 2020 @11:33AM (#25457114)
If they need that for their business are they really not using Red Hat?
Re:Rocky Linux: A CentOS replacement by the CentOS founder by tmoravec on Wednesday December 16, 2020 @01:45PM (#25446573)
Debian offers around three years of support. Ubuntu LTS around five. Both pale in comparison with Red Hat and, by proxy, CentOS.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by geofft on Wednesday December 16, 2020 @03:08PM (#25447846)
Debian eLTS offers 7 years: https://wiki.debian.org/LTS/Extended

That said, if you're really in the position of depending on a free project for over five years of security support, you probably will be totally fine with just ignoring the fact it's out of support. Just keep running Debian 6 for a decade, whatever. The code still runs. Pretend you've patched. Sure, there are probably some vulnerabilities, but you haven't actually looked to see if the project you're actually using right now has patched all the known vulnerabilities, have you?

(Spoiler, it hasn't: https://arxiv.org/abs/0904.4058)

Re:Rocky Linux: A CentOS replacement by the CentOS founder by joana035 on Wednesday December 16, 2020 @01:48PM (#25446622)
Right, but the price one pays are outdated packages.

CentOS 8 was released few days ago with kernel 4.18, which not even LTS is, and is older than the current Debian stable kernel(!).

If you need to install anything besides the base distro you need elrepo, epel, etc which I'm not sure can be counted as part of the support.

Re:Rocky Linux: A CentOS replacement by the CentOS founder by dralley on Wednesday December 16, 2020 @02:43PM (#25447484)
RHEL kernel versions are basically incomparable with vanilla kernel versions. They have hardware support and occasionally entire new features that have been backported from newer kernels in addition to the standard security & stability patches.

This means that RHEL 7 using a "kernel version" from 2014 will still work fine with modern hardware for which drivers didn't even exist in 2014.

Re:Rocky Linux: A CentOS replacement by the CentOS founder by the8472 on Wednesday December 16, 2020 @03:01PM (#25447752)
That is not a good thing. RH frankenkernels can contain subtle breakage. E.g. the Go and Rust standard libraries needed to add workarounds because certain RH versions implemented copy_file_range in a manner that returns error codes inconsistent with the documented API because patches were only backported for some filesystems but not for others. These issues never occurred on mainline.

And for the same reasons that the affected users chose a "stable" and "supported" distro they were also unable to upgrade to one where the issue was fixed.

Re:Rocky Linux: A CentOS replacement by the CentOS founder by dralley on Wednesday December 16, 2020 @03:22PM (#25448055)
True, but it is a matter of weighing risks. I can't find it now, but I remember a few years ago there was a news story about how an update to Ubuntu had caused hospitals to start rendering MRI scan results differently due to differences in the OpenGL libraries. For those sorts of use cases, stable is the only option.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by smarx007 on Wednesday December 16, 2020 @05:45PM (#25449816)
I think this is a perfect use case for CentOS/RHEL as opposed to Ubuntu when the machine has only one job and nothing shall stand in its way, ie when you expect everything to be bug-for-bug compatible. But I fail to understand why a vendor of an MRI machine charging tens of thousands for installation/support cannot provide a supported RHEL OS which costs $180-350/yr in the cheapest config [1].

[1]: https://www.redhat.com/en/store/linux-platforms

Re:Rocky Linux: A CentOS replacement by the CentOS founder by pezezin on Thursday December 17, 2020 @09:17AM (#25455735)
No, it doesn't. I will tell you my experience.

They bought some fancy new computers at work. Our procedures say to use CentOS 7, so we tried it, it ran like shit. Then we reinstalled CentOS 8, same. It worked, but the desktop was extremely slow. After much hair pulling I found the solution: add the elrepo-kernel repository, and update to kernel 5.x

No amount of backporting magic will make an old kernel work like a new kernel.

Re:Rocky Linux: A CentOS replacement by the CentOS founder by naniwaduni on Wednesday December 16, 2020 @02:15PM (#25447087)
That's not a price, that's a feature.

If your use case doesn't consider avoiding noncritical behaviour changes for a decade to be a feature, you have other options.

Re:Rocky Linux: A CentOS replacement by the CentOS founder by syshum on Wednesday December 16, 2020 @02:41PM (#25447458)
if you need epel, or quicker life cycles then CentOS Stream should be just fine for you as well

People that run CentOS in prod are normally running ERP systems, Databases, LoB Apps, etc, and the only thing we need is the base distro and the the vendor binaries for what ever is service/app that needs to be installed, and probably an old ass version is JDK...

We need every bit of that 10 year life cycle, and we glad that we will probably only have to rebuild these systems 2 or 3 times in our career before we pass the torch to the next unlucky SOB that has to support an application that was written before we were born...

that is CentOS Administration ;)

Re:Rocky Linux: A CentOS replacement by the CentOS founder by CoolGuySteve on Wednesday December 16, 2020 @02:07PM (#25446936)
The patch delta for security fixes must get larger over time as these packages age further and further away from top of tree.

I always wonder how many major vulnerabilities are introduced into these super old distros due to backporting bugs.

Re:Rocky Linux: A CentOS replacement by the CentOS founder by bonzini on Wednesday December 16, 2020 @03:26PM (#25448116)
It's the opposite. Plenty of subsystems in the RHEL 8.3 kernel are basically on par with upstream 5.5 or so, as almost all the patches are backported. The source code is really the same to a large extent, and therefore security fixes apply straightforwardly.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by Tom4hawk on Thursday December 17, 2020 @05:49AM (#25454407)
So, why is RHEL not using the upstream kernel? It would allow them to avoid those issues with rust&go (and probably other software): https://news.ycombinator.com/item?id=25447752
Re:Rocky Linux: A CentOS replacement by the CentOS founder by bonzini on Thursday December 17, 2020 @07:44AM (#25455047)
RHEL maintains a stable ABI for drivers.

Plus, there are changes (especially around memory management or scheduling) that are fiendishly hard to do regression testing on, so they are backported more selectively.

Re:Rocky Linux: A CentOS replacement by the CentOS founder by waheoo on Thursday December 17, 2020 @07:14AM (#25454881)
Security audit / certification would be my guess.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by CoolGuySteve on Wednesday December 16, 2020 @05:19PM (#25449567)
That's great but what about all the other packages?
Re:Rocky Linux: A CentOS replacement by the CentOS founder by bonzini on Thursday December 17, 2020 @02:44AM (#25453520)
The upstream for most other packages generally move much more slowly than the kernel. The fast ones (e.g. X11, systemd, QEMU) are typically rebased every other update or so (meaning, roughly once a year).

It also helps that Red Hat employs a lot of core developers for those fast moving packages. :)

Re:Rocky Linux: A CentOS replacement by the CentOS founder by jtl999 on Wednesday December 16, 2020 @02:11PM (#25447016)
Documented cases don't seem to be common, but what comes to mind is the Debian "weak keys" scandal (2008), and the VLC "libeml" vulnerability (2019)[1]

[1]: https://old.reddit.com/r/netsec/comments/ch86o6/vlc_security...

Re:Rocky Linux: A CentOS replacement by the CentOS founder by joana035 on Wednesday December 16, 2020 @02:19PM (#25447140)
OpenSSL upstream was almost abandoned during those days.

Software are always gonna have bugs, it's written by humans after all. The important thing is to acknowledge and work towards an ideal outcome.

Re:Rocky Linux: A CentOS replacement by the CentOS founder by kasabali on Thursday December 17, 2020 @08:49AM (#25455512)
Xweak keys" didn't have anything to do with backporting fixes to older versions. It was introduced into the version in sid at the time.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by houseofzeus on Wednesday December 16, 2020 @04:03PM (#25448619)
The kind of people that are up in arms that CentOS 8 isn't going to be supported through to 2029 are using it because it has outdated packages.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by citiguy on Wednesday December 16, 2020 @01:51PM (#25446686)
Agreed, the packages in Centos / RHEL are all super old. The RHEL license structure changes all the time and depending on which one you get it may or may not include the extended repos.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by mmrezaie on Wednesday December 16, 2020 @02:00PM (#25446832)
Honestly that support is meaningless for some areas I know. In our Data Center we have hit problems with old packages and at the end you will end up with a lot of your own packages. In the end I find Debian to be a good base, and you build the rest by yourself. Even though I use Fedora for Desktop, I always have a feeling Debian is the server choice which I can extend further.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by goodpoint on Wednesday December 16, 2020 @03:37PM (#25448252)
This is false. Debian provides LTS with a 5-years timespan. [1]

And there is even commercial support for Extended LTS now [2]

Also, it's worth noticing that Debian provides security backports for a significantly larger set of packages and CPU architectures than other distributions.

[1] https://wiki.debian.org/DebianReleases

[2] https://wiki.debian.org/LTS/Extended

Re:Rocky Linux: A CentOS replacement by the CentOS founder by antoncohen on Wednesday December 16, 2020 @04:36PM (#25449084)
Do you trust Debian LTS? As much as RHEL? The documentation about Debian LTS always made me think it is not a fully fledged thing. I've always felt like Debian releases reached EOL on their EOL date, not their LTS EOL date.

> Debian LTS is not handled by the Debian security team, but by a separate group of volunteers and companies interested in making it a success.

https://wiki.debian.org/LTS

Re:Rocky Linux: A CentOS replacement by the CentOS founder by tmoravec on Wednesday December 16, 2020 @03:49PM (#25448424)
Good catch, I stand corrected. But the point still holds - five (or even seven) years is still not match for Red Hat.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by uep on Wednesday December 16, 2020 @05:11PM (#25449480)
Do you know something I don't? A few years back, Debian changed their LTS policy to 5 years in response to Ubuntu.

> Debian Long Term Support (LTS) is a project to extend the lifetime of all Debian stable releases to (at least) 5 years. Debian LTS is not handled by the Debian security team, but by a separate group of volunteers and companies interested in making it a success.

> Thus the Debian LTS team takes over security maintenance of the various releases once the Debian Security team stops its work.

https://wiki.debian.org/LTS

Re:Rocky Linux: A CentOS replacement by the CentOS founder by unethical_ban on Wednesday December 16, 2020 @02:05PM (#25446915)
Arguably, no one should be running a server that long in 2020.

I would say a better reason is that while both are Linux distributions, they are distinct dialects and ecosystems. It isn't impossible to switch, but for institutions that have complex infrastructure built around the RHEL world, it is a lot of work to convert.

Re:Rocky Linux: A CentOS replacement by the CentOS founder by chousuke on Wednesday December 16, 2020 @02:50PM (#25447598)
It's not really about running servers for 10 years. It's about having a platform to build a product on that you can support for 10 years. RHEL software gets old over time, but it's still maintained and compatible with what you started on.

Consider an appliance that will be shipped to a literal cave for some mining operation. Do you want to build that on something that you would have to keep refreshing every year, so that every appliance you ship ends up running on a different foundation?

Re:Rocky Linux: A CentOS replacement by the CentOS founder by brandonmenc on Wednesday December 16, 2020 @03:03PM (#25447785)
> Consider an appliance that will be shipped to a literal cave

This.

A decade ago I was technical co-founder of a company [0] that made interactive photo booths and I chose CentOS for the OS.

There are some out in the wild still working and powered on 24/7 and not a peep from any of them.

We only ever did a few manual updates early on - after determining that the spotty, expensive cellular wasn't worth wasting on non-security updates - so most of them are running whatever version was out ten years ago.

Rock solid.

[0] https://sooh.com

Re:Rocky Linux: A CentOS replacement by the CentOS founder by deckard1 on Wednesday December 16, 2020 @03:35PM (#25448234)
The "don't touch it if it's not broken" philosophy is fundamentally at odds with an internet-connected machine.

You either need to upgrade or unplug (from the internet).

There are still places out there that are running WindowsNT or DOS even. Because they have applications which simply won't run anywhere else or need to talk to ancient hardware that runs over a parallel port or some weird crap like that. These machines will literally run forever, but you wouldn't connect it to the internet. Your hypothetical cave device would be the same.

Upgrading your OS always carries risk. Whether it's a single yum command or copying your entire app to a new OS.

Besides, if you're on CentOS 8 then wouldn't you also be looking at Docker or something? Isn't this a solved problem?

Re:Rocky Linux: A CentOS replacement by the CentOS founder by chousuke on Thursday December 17, 2020 @03:15AM (#25453672)
The point is the amount of "touching". Applying security patches to RHEL is still a change, but it's significantly less risky than upgrading a faster-changing system where you might not even get security patches at all for the versions of software you're using unless you switch to a newer major version.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by effie on Wednesday December 16, 2020 @05:00PM (#25449378)
"don't touch it if it's not broken" is not a philosophy, it is a slogan. Some people say it, because it is preferable to them to run old unpatched vulnerable systems rather than spend resources on upgrades. That's just a reality. Some care about up-to-date, some don't. Most people don't really care about security, and some of those don't care even about CYA security theatre. If they did care about security, they wouldn't run unverified software downloaded from the Internet.

Why Docker has anything to do with this discussion?

Re:Rocky Linux: A CentOS replacement by the CentOS founder by effie on Wednesday December 16, 2020 @05:05PM (#25449424)
I think it is mostly about running servers (standard services that don't change much) for 10 years (and more). You don't need 10 year LTS distribution for building a product. You take whatever version of OS distribution you like, secure local copy should the upstream disappear, and vendor it into your product and never deviate from it.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by dmix on Wednesday December 16, 2020 @03:02PM (#25447774)
I'm assuming this involve upgrading the application often as well?
Re:Rocky Linux: A CentOS replacement by the CentOS founder by NotHereNotThere on Wednesday December 16, 2020 @02:59PM (#25447720)
OK I'll bite..

How would I run our SAP ERP apps/databases without "running servers that long"?

Re:Rocky Linux: A CentOS replacement by the CentOS founder by unethical_ban on Wednesday December 16, 2020 @03:38PM (#25448261)
Of course there are use cases, but _ideally_, most workloads are staged, deployed, and backed up in such a way that it is a documented, reproducible procedure to tear down an instance of a server, rebuild, and redeploy services.

And while it may be cumbersome or cause some downtime or headaches if that isn't the case, I find the very need of doing it once every 1-3 years forces your hand to get your shit together, rather than a once per decade affair of praying you migrated all your scripts manually and that everything will work, as your OS admins threaten your life because audit is threatening theirs.

Re:Rocky Linux: A CentOS replacement by the CentOS founder by effie on Wednesday December 16, 2020 @05:09PM (#25449460)
How many simultaneously running machines can you keep updating with this method? If you run non-trivial workloads for hundreds of customers, this becomes high maintenance system already with two machines. It takes ages to upgrade all applications, then validate everything works, then actually migrate with no downtime.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by petepete on Wednesday December 16, 2020 @03:23PM (#25448065)
Run them on Kubernetes in GCP with a containerised DB2!
Re:Rocky Linux: A CentOS replacement by the CentOS founder by joana035 on Wednesday December 16, 2020 @02:12PM (#25447027)
> Arguably, no one should be running a server that long in 2020

The main reason people choose Linux is due to its stability.

It is totally ok to run servers in 2020.

Also your statement seems the default cloud vendor lingo used to push people to adopt proprietary technology with high vendor lock-in.

Re:Rocky Linux: A CentOS replacement by the CentOS founder by mdeeks on Wednesday December 16, 2020 @02:54PM (#25447663)
I think they only meant "that long". In other words, not for 5+ years without an upgrade. Not that you shouldn't run them at all.

Not everything can be highly ephemeral or a managed service, so running servers yourself is totally okay like you said.

Re:Rocky Linux: A CentOS replacement by the CentOS founder by joana035 on Wednesday December 16, 2020 @03:24PM (#25448073)
You are right, I misunderstood his message.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by that_guy_iain on Wednesday December 16, 2020 @02:54PM (#25447669)
Honestly, 10 years is a long time for a server. I would be honestly surprised if a server lasted 10 years.

But I agree I also get the tone of "servers should be cattle and not pets, just kill them and build a new one". Which can also be done on bare metal if you're using vms/containers. It seems like most people forget these cloud servers need to run on bare metal.

Re:Rocky Linux: A CentOS replacement by the CentOS founder by bcrosby95 on Wednesday December 16, 2020 @03:29PM (#25448152)
Really? We've colocated our servers for the past 18 or so years.

We have about 40. The oldest is around 17 years old. Our newest server is 9 years old. Our average server age is probably around 13 years old.

The most common failure that completely takes them out of commission is a popped capacitor on the motherboard. Never had it happen before the 10 year mark.

Never had memory failure. Have had disk failures, but those are easy to replace. Had one power supply failure, but it was a faulty batch and happened within 2 years of the server's life.

Re:Rocky Linux: A CentOS replacement by the CentOS founder by that_guy_iain on Wednesday December 16, 2020 @04:29PM (#25448977)
The last time I worked with a ~8 year old server, it used to go through hard drives at a rate of 1 every 2 months. While we could replace them easily and it was RAID so there wasn't any data loss, I personally would've got fed up of replacing HDDs every couple of months.

Also, most of my experience is with rented dedicated servers and they just give me a new one completely so I never really see if they're fully scrapped.

Re:Rocky Linux: A CentOS replacement by the CentOS founder by bcrosby95 on Wednesday December 16, 2020 @07:05PM (#25450524)
We haven't had any hardware failures - hard drive or otherwise - in the last 5 months.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by moonbug on Wednesday December 16, 2020 @02:32PM (#25447355)
>Arguably, no one should be running a server that long in 2020.

That's mental.

Re:Rocky Linux: A CentOS replacement by the CentOS founder by Karunamon on Wednesday December 16, 2020 @02:39PM (#25447431)
My read on that is that you should be treating your servers as disposable and ephemeral as possible. Long uptimes mean configuration drift, general snowflakery, difficulties patching, patches getting delayed/not done, and so forth.

Ideally you'd never upgrade your software in the usual way. You'd simply deploy the new version with automated tooling and tear down the older.

Re:Rocky Linux: A CentOS replacement by the CentOS founder by hibbelig on Wednesday December 16, 2020 @03:32PM (#25448191)
I don't get this. If there are many servers, sure. But if it's something that runs on a single box without problem, why on earth should I tear it down?

Also, "running a server for ten years" does not need to mean that it has ten years of uptime. I think that wasn't meant.

Re:Rocky Linux: A CentOS replacement by the CentOS founder by moonbug on Wednesday December 16, 2020 @04:54PM (#25449305)
Ten years of uptime seems neither an unreasonable nor unattainable requirement. There's more to computers than mayfly web startups.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by hibbelig on Thursday December 17, 2020 @11:34AM (#25457125)
If it's not connected to the Internet, okay.

If it is connected to the Internet, then I guess the kernel needs to be hot-patched need to be applied to avoid security issues.

Were hot kernel patches available ten years ago? I remember some company who did this (for Linux), and it was quite a while back, so it's possible. But I doubt it was mainstream.

I recall long ago that SunOS boxes had to be rebooted for kernel patches.

I don't remember about Solaris.

I'm not familiar with other Unices.

Re:Rocky Linux: A CentOS replacement by the CentOS founder by moonbug on Thursday December 24, 2020 @08:20AM (#25527190)
ksplice, and it's an Oracle product
Re:Rocky Linux: A CentOS replacement by the CentOS founder by NDizzle on Wednesday December 16, 2020 @02:51PM (#25447605)
"Ideally" - that's the problem. I have half a dozen long tail side projects running right now on Centos 7, and a few still on Centos 6.

Do you have any idea how much effort it is to change everything over to "treating your servers as disposable"?! It's going to eat up a third (to half) of my "fun time" budget for the foreseeable future!

Re:Rocky Linux: A CentOS replacement by the CentOS founder by effie on Wednesday December 16, 2020 @05:18PM (#25449559)
Exactly, young devs here are completely out of touch with operations. Of course ideally something like standard 1TB HDD+32GB RAM system would be upgraded to newer OS and apps version by a central tool in 2hours, but we don't such FM technology yet.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by cat199 on Wednesday December 16, 2020 @03:45PM (#25448354)
> automated tooling

the 'usual way' is automated tooling

Re:Rocky Linux: A CentOS replacement by the CentOS founder by tw04 on Wednesday December 16, 2020 @03:24PM (#25448074)
Rocky is going to be exactly what CentOS was: a free version of RHEL. The reason you would use this vs. Debian or Ubuntu is because you've got systems that need to mirror your production, but you don't want/need enterprise support on them.

When I worked for a hardware vendor we had customers who ran hundreds of CentOS boxes in dev/test alongside their production RHEL boxes. If there was an issue with a driver, we simply asked that they reproduce it on RHEL (which was easy to do). If they had been running debian or ubuntu LTS the answer would have been: I suggest you reach out the development mailing list and seek out support there.

Whether you like it or not, most hardware vendors want/require you to have an enterprise support contract on your OS in order to help with driver issues.

Re:Rocky Linux: A CentOS replacement by the CentOS founder by loop0 on Wednesday December 16, 2020 @02:18PM (#25447132)
Because CentOS on enterprise hardware is way more stable than Debian. I've worked for 6 years as a sysadmin for 300+ servers and we migrated everything from Debian to CentOS and our hardware related issues just went away. Overall we had much less trouble in our systems.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by pak9rabid on Wednesday December 16, 2020 @03:23PM (#25448067)
That's probably because lots of enterprise hardware is only ever tested and certified to work with RHEL, and in many cases only provided drivers in an RPM format that's intended to be installed in a RHEL-like environment.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by nycticorax on Wednesday December 16, 2020 @05:28PM (#25449663)
Which is a good reason someone might choose a RHELish distro over Debian, no?
Re:Rocky Linux: A CentOS replacement by the CentOS founder by viraptor on Wednesday December 16, 2020 @03:08PM (#25447844)
Apart from the long support, RHEL based distros also give you built in selinux support. Apparmor exists, but it's not comparable in features and existing policies.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by throwaway092835 on Wednesday December 16, 2020 @04:06PM (#25448650)
selinux is provided by Debian as well and it's hardly a popular (or very useful) feature compared to daemon and application sandboxing.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by viraptor on Wednesday December 16, 2020 @04:53PM (#25449295)
The module itself is provided, yes. The policies are not really integrated into Debian systems. You can adjust them to work, but it's way more work than using ready ones on a RHEL-like system.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by theevilsharpie on Wednesday December 16, 2020 @02:39PM (#25447434)
> I am really interested to know why should anyone go with this when Debian or Ubuntu LTS exist.

There is a large world of proprietary enterprise software that is tested, developed, and supported solely on RHEL. CentOS (and theoretically, Rocky Linux) can run these applications because they are essentially a reskin of RHEL. Debian and Ubuntu LTS cannot (or at least not in a supported state) because they are not RHEL.

Re:Rocky Linux: A CentOS replacement by the CentOS founder by ernst_klim on Wednesday December 16, 2020 @04:23PM (#25448893)
> when Debian or Ubuntu LTS exist

I'm not familiar with Debian, do they have same infrastructure and documentation quality as RHEL? For example do they have anything like Koji [1] for easy automated package building?

[1] https://koji.fedoraproject.org/koji/

Re:Rocky Linux: A CentOS replacement by the CentOS founder by jpalomaki on Wednesday December 16, 2020 @02:59PM (#25447721)
Not an expert, but I’ve understood CentOS was interesting for people who run RedHat for production, but want something free for non-prod hosts.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by davoneus on Thursday December 17, 2020 @04:48PM (#25460951)
This.

We used CentOS as dev environments, and RHEL as production. It gave us the best of both worlds; an unsupported but compatible and stable dev environment we could bring up and throw away as much as we wanted _Without_ licensing BS. And when the devs were happy with it, the move of a project to RHEL was easy and uneventful.

And don't even get me started on the 'free' dev version of RHEL. It's a PITA to use, we've tried. It's also why we've halted our RH purchasing for the moment. Sure, it's caused our RHEL reps no end of consternation and stress but too bad. I've been honest with them, and told them that they are probably lying through their teeth (without knowing it) when they parrot the line that RH will have some magic answer for "expanded" and/or "reduced cost" Streams usage in "1st half of 21". That trust died when RH management axed CentOS8 like they did.

Re:Rocky Linux: A CentOS replacement by the CentOS founder by dmix on Wednesday December 16, 2020 @03:06PM (#25447816)
For me it's always been about stability and the long term support of a 'free' distribution. That has also historically been their bread and butter which got them wide-adoption.

The branding stuff was a plus to the sys-admins and Linux die hards.

Re:Rocky Linux: A CentOS replacement by the CentOS founder by paul_f on Wednesday December 16, 2020 @02:21PM (#25447185)
If you're using Cpanel, you have no choice but to use Redhat, CentOS or Fedora.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by syshum on Wednesday December 16, 2020 @02:44PM (#25447508)
That is changing, they are going to Support CloudLinux, and Ubuntu now

https://blog.cpanel.com/centos-8-end-of-life-announcement/

Re:Rocky Linux: A CentOS replacement by the CentOS founder by paul_f on Wednesday December 16, 2020 @10:08PM (#25451957)
Glad to see, but worry that Cpanel on Ubuntu coming in late 2021, corresponding to the end of CentOS 8, is cutting it close.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by shawnz on Wednesday December 16, 2020 @02:15PM (#25447085)
You may need to develop or test software for RHEL and CentOS/Rocky are bug-for-bug compatible.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by hitpointdrew on Wednesday December 16, 2020 @01:44PM (#25446564)
I am simply not a fan of Debian/Ubuntu's utilities, with the big one being the package manager (I like yum/dnf way better), but also other things like ufw vs firewalld.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by tijuco2 on Wednesday December 16, 2020 @03:10PM (#25447872)
same here
Re:Rocky Linux: A CentOS replacement by the CentOS founder by Shorel on Wednesday December 16, 2020 @05:29PM (#25449674)
Switching distributions is an uphill fight when the company has used a version of RedHat for 20 years.

Most developers use Ubuntu in their laptops. Virtualized on Windows, but Ubuntu nonetheless.

Re:Rocky Linux: A CentOS replacement by the CentOS founder by itsjustjoe on Wednesday December 16, 2020 @02:57PM (#25447696)
rpm. If your systems are built around rpm already that alone is a good enough reason.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by pak9rabid on Wednesday December 16, 2020 @03:20PM (#25448010)
Drivers for hardware that were only ever intended to work with RHEL (EMC's PowerPath drivers, for example).
Re:Rocky Linux: A CentOS replacement by the CentOS founder by dharmab on Wednesday December 16, 2020 @01:42PM (#25446525)
Debian's package policies can be challenging for rapidly updating packages: https://lwn.net/Articles/835599/
Re:Rocky Linux: A CentOS replacement by the CentOS founder by mmrezaie on Wednesday December 16, 2020 @01:58PM (#25446796)
For packages like Kubernetes or big data packages one should not use anyone else's builds. I have been finding problems in Cray's modules and eventually we are using our own builds we can reproducibly support using Spack.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by symlinkk on Wednesday December 16, 2020 @03:17PM (#25447973)
I would say for any piece of software, if the vendor themselves provide a package for your distro, use that, not the distro version.

In fact I’ll go a step further and say Windows and macOS got this right, in that third party developers should do the work to “package” their apps.

It would be insane for Microsoft to maintain packages for every piece of software that ships on Windows, but somehow that’s the situation we’re in with Linux.

Hopefully Snap or Flatpak changes this!

Re:Rocky Linux: A CentOS replacement by the CentOS founder by yjftsjthsd-h on Wednesday December 16, 2020 @05:41PM (#25449775)
> It would be insane for Microsoft to maintain packages for every piece of software that ships on Windows, but somehow that’s the situation we’re in with Linux.

And this is why installing ex. Filezilla on Linux is safe and easy, and doing the same on Windows is neither.

Re:Rocky Linux: A CentOS replacement by the CentOS founder by jcastro on Wednesday December 16, 2020 @01:50PM (#25446673)
Both Debian and CentOS have the same problem here, you're not going to install kubernetes from a default repo on any traditional distro.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by area51org on Wednesday December 16, 2020 @04:26PM (#25448921)
Debian/Ubuntu are great. However, there are people and companies that prefer the Red Hat way. That's also great.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by mmrezaie on Wednesday December 16, 2020 @01:37PM (#25446423)
By understanding the stability I mean the other two are as stable as far as I have experienced them in the last decade.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by em500 on Wednesday December 16, 2020 @04:08PM (#25448690)
To system administrators and people managing large fleets of servers "stability" usually means "doesn't change much" rather than "doesn't crash". In that sense, RHEL tended to be more stable than Debian / Ubuntu. Though that may change somewhat with Ubuntu's recent 10 year LTS plans.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by throwaway201103 on Wednesday December 16, 2020 @01:41PM (#25446510)
Agreed. I've used and advocated for RHEL/CentOS at work since version 5 because it was stable and predictible. That's gone now, and many of my users would prefer Ubuntu anwyay because it's what they use on their personal machines. So I'm making plans to move all our compute resources to Ubuntu LTS.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by effie on Wednesday December 16, 2020 @05:26PM (#25449646)
I'm wary of doing that, because in near future, Microsoft is likely to take over Canonical. You don't put all eggs into one basket. Always plan for escape, always have a plan B. Preferably one not relying on crystal-balling whims of a for-profit corporation. Rocky Linux, Alpine Linux, Debian, Gentoo, BSD, etc.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by curt15 on Wednesday December 16, 2020 @07:30PM (#25450759)
>Microsoft is likely to take over Canonical.

This is not the first time I've seen this prediction. What is its basis?

Re:Rocky Linux: A CentOS replacement by the CentOS founder by effie on Thursday December 17, 2020 @05:51PM (#25461587)
There have been some interesting observations on HN and elsewhere, that Canonical for a long time didn't know what it is doing, starting and cancelling projects, but in last years it is lowering interest in desktop and is more focused on providing cloud server software and foisting its new products and methodologies on its users(snap). Some people see this as indication that Canonical is positioning itself to be bought for the best price. It makes sense, as Canonical has a large Linux user base but can't make money there. Microsoft is making inroads in Linux world is the most likely buyer.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by type0 on Thursday December 17, 2020 @08:47AM (#25455493)
there has been some collaboration between the two, however MS collaborates with other small companies and that speculation never arises. I wouldn't set a bet that they're uninterested in Canonical, but the desire to buy it has always been overstretched, it is much bigger chance that they buy some other specialized distro vendor instead (like Google buying Neverware). Ubuntu is too generic in that sense.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by jessaustin on Wednesday December 16, 2020 @05:57PM (#25449933)
Moving a server from Ubuntu to Debian doesn't seem a very arduous task? I've got a box in a rack that came from the factory with Ubuntu installed, but there are Debian addresses in /etc/apt/sources.list.d

Besides isn't that pretty much the exemplar of FUD?

Re:Rocky Linux: A CentOS replacement by the CentOS founder by effie on Wednesday December 16, 2020 @06:05PM (#25449994)
But it is still a task, isn't it? So, now you move to Ubuntu, then if things get south, you move to Debian. Or, you could move to Debian or other less risky distribution now and likely save some time and energy.

On the other hand, maybe Ubuntu is providing something special that Debian can't do - then it may make sense to go with Ubuntu and maybe even swallow Microsoft's fishing hook if it comes.

Re:Rocky Linux: A CentOS replacement by the CentOS founder by citiguy on Wednesday December 16, 2020 @01:49PM (#25446643)
Lately it seems to me Debian and Ubuntu have made some strange package decisions. They have morphed into a desktop oriented build with snap packages and auto-updates enabled by default (among other strange decisions). There's a ton of stuff we always end up disabling in the new release because it's super buggy and doesn't work well (I work at a small MSP). I'm not sure who replaced Ian Jackson, but Debian seems rudderless.

Centos was the rational other free choice, not that Red Hat hasn't made other equally strange decisions.

Sometimes I think we'd be better off rolling our own, like Amazon does.

Re:Rocky Linux: A CentOS replacement by the CentOS founder by vbezhenar on Wednesday December 16, 2020 @02:11PM (#25447014)
I'm using Debian and I don't use snap packages. I guess it's optional? I just installed Minimal and installed few packages I needed.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by sjellis on Wednesday December 16, 2020 @02:38PM (#25447423)
Snap is an Ubuntu thing. It's basically a client for the Canonical app store.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by sliken on Wednesday December 16, 2020 @08:27PM (#25451199)
Snap is proprietary and has a fairly broken implementation. Seems impressively good at preventing machines from booting, polluting the filesystem namespace (who wants 100 lines in every df?), doesn't seem to handle versioning or garbage collection well.

Server side isn't open, and Canocial repeatedly claims wide industry support ... despite not having it.

I recommend the first step in any Ubuntu system you use is to disable snap. Use something portable like flatpak that does at least have some support, is open source, and seems to have a healthy eco system.

Re:Rocky Linux: A CentOS replacement by the CentOS founder by jessaustin on Wednesday December 16, 2020 @08:18PM (#25451132)
Even on ubuntu, you don't have to use it. I don't.
Re:Rocky Linux: A CentOS replacement by the CentOS founder by type0 on Thursday December 17, 2020 @08:57AM (#25455582)
That's the only sane way to use Ubuntu. Snap is abomination