Benchmark Framework Desktop Mainboard and 4-node cluster

Re:Benchmark Framework Desktop Mainboard and 4-node cluster by jcastro on Thursday August 07, 2025 @04:58PM (#44830288)

Hi Jeff, I'm a linux ambassador for Framework and I have one of these units. It'd be interesting if you would install ramalama in fedora and test that. I've been using that out of the box as a drop in replacement for ollama and everything was GPU accelerated out of the box. It pulls rocm from a container and just figures it out, etc. Would love to see actual numbers though.

Great work on this!

[ Parent | on HN ]

Re:Benchmark Framework Desktop Mainboard and 4-node cluster by nicolaslem on Friday August 08, 2025 @09:10AM (#44836549)

I gave it a try on my Strix Halo laptop on Arch. ROCm and everything else worked out of the box with two commands:

    uv tool install ramalama
    ramalama serve <model>

[ Parent | on HN ]