News for hackers. Stuff that matters.
Re:Mapping Out the HPC Dependency Chaos by MontyCarloHall on Friday November 11, 2022 @02:57PM (#33565965)
Why not just containerize your software and run the container on the HPC cluster?
Re:Mapping Out the HPC Dependency Chaos by bayindirh on Friday November 11, 2022 @04:04PM (#33566824)
Disclosure: I’m an HPC admin.

Accessing InfiniBand and GPUs directly become a problem.

Rootless containers are also still at infancy, and creates a lot of problems. You don’t want to give indirect root access via docker group, too.

Re:Mapping Out the HPC Dependency Chaos by maxwell86 on Friday November 11, 2022 @10:44PM (#33569743)
> Accessing InfiniBand and GPUs directly become a problem.

I use nvidia containers on HPC systems every day and accessing NICs, doing RDMA to GPUs, etc. "just works" and performs as well as baremetal. Every time we upgrade our container we verify the new container with a set of benchmarks against both the old one and baremetal.

> You don’t want to give indirect root access via docker group, too.

I don't know of any HPC center using docker though. It does not sound like a good idea because the docker daemon runs as root..

Re:Mapping Out the HPC Dependency Chaos by throw0101c on Friday November 11, 2022 @04:34PM (#33567165)
> Why not just containerize your software and run the container on the HPC cluster?

Docker needs root access which is a big no-no in multi-user environments.

Singularity/Apptainer was developed (with HPC in mind) so that non-admin users could run containerized workloads, and Spack supports creating such workloads:

* https://spack.readthedocs.io/en/latest/containers.html

Re:Mapping Out the HPC Dependency Chaos by bayindirh on Friday November 11, 2022 @04:51PM (#33567357)
Singularity and Apptainer are not silver bullets tho. Both have their limitations and own problems to solve.

They will mature eventually, but bare metal is still the king in HPC realm.

Re:Mapping Out the HPC Dependency Chaos by throw0101c on Friday November 11, 2022 @05:09PM (#33567542)
We have bare metal HPC nodes, but some users want to run containerized apps for their batch jobs: it's not either-or, it's both-and.
Re:Mapping Out the HPC Dependency Chaos by bayindirh on Friday November 11, 2022 @11:05PM (#33569836)
Of course, it’s same for us. I just wanted to point out that these technologies cannot replace bare metal installations for every case as of today.