Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Serving AI from the Basement – 192GB of VRAM Setup. Parent comment
The Geekbench GPU compute benchmarks are nearly worthless in any context, and most certainly are useless for evaluating suitability for running LLMs, or anything involving multiple GPUs.
There are no comments on this comment yet.
The Geekbench GPU compute benchmarks are nearly worthless in any context, and most certainly are useless for evaluating suitability for running LLMs, or anything involving multiple GPUs.