News for hackers. Stuff that matters.
Re:CernVM File System by arjvik on Friday September 09, 2022 @02:59AM (#32776148)
At first I was wondering how this was different from something like Ceph or GlusterFS.

Looks like this isn't meant to be used on a LAN to squeeze out every bit of performance, but rather to work across hosts on different local networks over the whole internet (even passing through NATs) in a somewhat distributed fashion. Cool!

Re:CernVM File System by ephimetheus on Friday September 09, 2022 @03:12AM (#32776242)
Exactly. This is the software delivery mechanism for the LHC experiments. It’s a read only globally distributed (sort of) POSIX filesystem.

We use it in ATLAS to deploy both tagged releases and nightly builds. These can be about 100GB in size each.

The releases are used for production jobs across the worldwide grid, while the nightlies are used as development targets for individual developers.

Re:CernVM File System by selimnairb on Friday September 09, 2022 @05:12AM (#32777104)
Sounds like a read-only version of AFS [1], which had a global namespace and was used for software distribution as well as data sharing/collaboration. If you narrow the use case to software distribution, I suppose read only is a reasonable trade off if it enables higher performance.

[1] https://en.m.wikipedia.org/wiki/Andrew_File_System

Re:CernVM File System by tempay on Friday September 09, 2022 @04:44AM (#32776892)
The biggest thing is that it’s read-only[1] and aims for high performance massively distributed reads (millions of clients).

[1] Though for publishing files you have have many concurrent transactions open from different machines so long as they lock unique paths.

Re:CernVM File System by pengaru on Friday September 09, 2022 @03:14AM (#32776256)
Erm, it's not even a read-write filesystem.

It appears to simply be a read-only POSIX-fs interface to Merkle-encapsulated bits distributed via http.

Ceph and Gluster are completely different animals.

Re:CernVM File System by zcw100 on Friday September 09, 2022 @07:01AM (#32777735)
It sounds more like IPFS