News for hackers. Stuff that matters.

o7ri6246iu45

Re:Apptainer: Application Containers for Linux on Thursday June 26, 2025 @03:44PM (#44390605)
the "network tax" is not really a network tax. the network is generally a dedicated storage network using infiniband or roce if you cheap out. the storage network and network storage is generally going to be faster than local nvme.
Re:Apptainer: Application Containers for Linux on Thursday June 26, 2025 @03:43PM (#44390593)
there generally is no central shared immutable image store because every job is using its own collection of images.

what you're describing might work well for a small team, but when you have a few hundred to thousand researchers sharing the cluster, very few of those layers are actually shared between jobs

even with a handful of users, most of these container images get fat at the python package installation layer, and that layer is one of the most frequently changed layers, and is frequently only used for a single job