News for hackers. Stuff that matters.
Re:Orphaning bcachefs-tools in Debian by haileys on Saturday August 31, 2024 @09:17AM (#41408668)
Thanks for taking the time to comment here!

> So then he breaks the build by switching to the packaged version of bindgen, an old unsupported version.

Could bcachefs-tools solve this problem upstream of distros by releasing a source tarball with the bindings already generated, so that you can use whatever version of bindgen you want, and bindgen is not needed at all when building from this release tarball?

This would be similar in nature to traditional autotools approach where some amount of pre-compilation is done to produce a release tarball from what actually lives in the source repository.

It's also what I do for some of my ffi crates. I have a script in the root of the repo which regenerates the bindings, but when published to crates.io, the bindings are already generated and bindgen is not part of the build downstream of my crate.

Re:Orphaning bcachefs-tools in Debian by koverstreet on Saturday August 31, 2024 @09:21AM (#41408695)
I already provide tarballs with vendored dependencies - I did this for Fedora, so that package builds wouldn't have to download anything.

I'm not going to special case the bindgen bindings because this really isn't a bindgen specific issue - this could just as easily been any other dependency.

Re:Orphaning bcachefs-tools in Debian by haileys on Saturday August 31, 2024 @09:36AM (#41408784)
Speaking from practical experience, bindgen is a particularly heavyweight dependency. It requires libclang to be available and also adds a considerable amount of time to the compile. If it makes compiling the software easier - and end users compiling the software themselves would benefit here as well as distro maintainers - then it would seem like a pragmatic move to me.
Re:Orphaning bcachefs-tools in Debian by koverstreet on Saturday August 31, 2024 @09:59AM (#41408919)
This really isn't about bindgen.

Any time a dependency is changed, the package version should be bumped and retested. This is a massive improvement in reproducibility, bisectability and our ability to QA.

Before this model, bisecting breakage that was a result of a change in library 'a' breaking something in consumer 'b' was effectively impossible; now it is.

What Debian and Fedora have been doing is a big step backwards, this whole 'unbundling of dependencies' (that were going to be statically linked anyways) needs to die.

Re:Orphaning bcachefs-tools in Debian by boris on Saturday August 31, 2024 @11:39AM (#41409631)
> What Debian and Fedora have been doing is a big step backwards, this whole 'unbundling of dependencies' (that were going to be statically linked anyways) needs to die.

I am a Debian user of a couple of decades and I would like this unbundling of dependencies to live on (because I understand the benefits and they are important to me). I am, however, happy for projects like yours (and other similar "move fast and break things" junk) to never be packaged for Debian.

Re:Orphaning bcachefs-tools in Debian by steve-rambo-fan on Saturday August 31, 2024 @03:30PM (#41411269)
The only "junk" I'm seeing here is your comment. If you don't find bcachefs interesting, please move along and keep your bitter thoughts to yourself. Last thing we need is more assholes harassing Kent into throwing in the towel on the best GPL-compatible alternative to ZFS we're likely to have in decades.
Re:Orphaning bcachefs-tools in Debian by brnt on Saturday August 31, 2024 @10:50AM (#41409286)
> What Debian and Fedora have been doing is a big step backwards, this whole 'unbundling of dependencies' (that were going to be statically linked anyways) needs to die.

They, and most others, have been doing that since their respectively beginnings, and for good reasons: everybody expects distros to fix security issues, which is greatly aided by ensuring an-as-small-as-necesary dep tree and thus a single version of any particular dep.

Changing that isn't impossible, but I am not aware of any distro that's managing this and be widely considered 'stable'.

How can distros change while keeping up their end which is stability and robustness in the face of bugs and security issues?

Re:Orphaning bcachefs-tools in Debian by cesarb on Saturday August 31, 2024 @10:59AM (#41409347)
> They, and most others, have been doing that since their respectively beginnings

As I explained on another comment of mine (https://news.ycombinator.com/item?id=41409199), it's not since their beginning, but since a particular zlib security incident which showed them the risks of vendored libraries. Any discussion of vendoring policy which does not consider that incident is necessarily incomplete.

Re:Orphaning bcachefs-tools in Debian by koverstreet on Saturday August 31, 2024 @11:39AM (#41409627)
That's very nearly a solved problem at this point; I get notified by bots (github, mainly) if a dependency has as a security vulnerability, and then it's very nearly a one click action to do a cargo update and commit the new lockfile.

The distro people could've been working on the tooling for automating this at the distro level (and some people in debian are doing work that would enable this); we don't need to go this insane "unbundle everything" route.

Re:Orphaning bcachefs-tools in Debian by brnt on Sunday September 01, 2024 @09:41AM (#41416904)
Before broadband, and before forges like github with free CI and bots, which is all fairly recent, distros packaged everything was a godsend, not insane.
Re:Orphaning bcachefs-tools in Debian by brnt on Saturday August 31, 2024 @11:06AM (#41409401)
How long ago was that? And did they quantify the problem?
Re:Orphaning bcachefs-tools in Debian by IshKebab on Sunday September 01, 2024 @04:30AM (#41415234)
> everybody expects distros to fix security issues

IMO this is a huge mistake in the Linux distro world. It doesn't scale. It's similar to the weird idea that Debian should contain every program in the world and if the authors want their programs to be installable on Debian they must make a Debian package for it. And Fedora and Arch and Gentoo and...

Clearly bonkers.

Re:Orphaning bcachefs-tools in Debian by brnt on Sunday September 01, 2024 @09:39AM (#41416887)
Debian does not prevent you from installing stuff from elsewhere, it's just that their packages come with certain availability and stability guarantees. You may not care for them, but clearly bonkers it is clearly not.