News for hackers. Stuff that matters.
Re:Serving AI from the Basement – 192GB of VRAM Setup by wtallis on Sunday September 08, 2024 @06:09PM (#41483663)
> From benchmarks alone, you can easily tell that the performance-per-watt of any Mac Studio gets annihilated by a 4090: https://browser.geekbench.com/opencl-benchmarks

The Geekbench GPU compute benchmarks are nearly worthless in any context, and most certainly are useless for evaluating suitability for running LLMs, or anything involving multiple GPUs.

There are no comments on this comment yet.