Re:Grace Hopper, Nvidia's Halfway APU
by sirlancer on Saturday August 10, 2024 @01:32PM
(#41210960)
In my tests of a Supermicro ARS-111GL-NHR with a Nvidia GH200 chipset, I found that my benchmarks performed far better with the RHEL 9 aarch64+64k kernel versus the standard aarch64 kernel. Particularly with LLM workloads. Which kernel was used in these tests?
[ Parent
| on HN ]
"Far better" is a little vague, what was the actual difference?
Re:Grace Hopper, Nvidia's Halfway APU
by magicalhippo on Saturday August 10, 2024 @03:39PM
(#41211725)
Not OP but was curious about the "+64k" thing and found this[1] article claiming around 15% increase across several different workloads using GH200.
FWIW for those unaware like me, 64k refers to 64kB pages, in contrast to the typical 4kB.
[1]: https://www.phoronix.com/review/aarch64-64k-kernel-perf