Re:Apptainer: Application Containers for Linux
by lazylizard on Monday June 30, 2025 @05:10AM
(#44421099)
https://slurm.schedmd.com/containers.html
support for containers sort of exists. singularity is the friendliest.
https://modules.readthedocs.io/en/latest/ re-used libraries are packaged this way usually. not in container images.
there's no abstraction or live mirgation. there's only queues of jobs waiting to get cpu and/or gpu time.
This is how systems like AWS ECS, or even modern CI/CD providers, work. It's essentially a fleet of machines running Docker, with ephemeral storage and cached layers. For the CI/CD providers, they have millions of random jobs running all the time by tens of thousands of random people with random containers. Works fine. Requires tweaking, but it's an established pattern that scales well. They even re-schedule jobs from a particular customer to the previous VM for a "warm cache". Extremely fast, extremely large scale, all with containers.
It's made better by using hypervisors (or even better: micro-VMs) rather than bare-metal. Abstract the allocations of host, storage and network, makes maintenance, upgrades, live-migration, etc easier. I know academia loves its bare metal, but it's 2025, not 2005.