News for hackers. Stuff that matters.

A comment on Real-time LLM Inference on Standard GPUs: 3k tokens/s per request. Parent comment

Re:Real-time LLM Inference on Standard GPUs: 3k tokens/s per... by felooboolooomba on Friday May 29, 2026 @04:21PM (#48328682)
Certainly not 8× AMD MI300X GPUs and 2,100 on 8× NVIDIA H200
[ Parent | on HN ]

There are no comments on this comment yet.