News for hackers. Stuff that matters.
Re:Benchmark Framework Desktop Mainboard and 4-node cluster by cpburns2009 on Friday August 08, 2025 @09:31AM (#44836719)
Thanks for the correction. I was under the impression the GPU memory had to be preallocated in the BIOS, and 96 GB was the maximum number I read about.
Re:Benchmark Framework Desktop Mainboard and 4-node cluster by sliken on Saturday August 09, 2025 @12:48AM (#44844100)
Some older software stacks require static allocation in BIOS, but things are moving pretty quickly and allow dynamic allocation. Newer versions (or patches to) pytorch, ollama, and related, which I think might depend on a newer kernel (6.13 or so). Does seem like there's been quite a bit of progress in the last month.