News for hackers. Stuff that matters.

A comment on Real-time LLM Inference on Standard GPUs: 3k tokens/s per request. Parent comment

Re:Real-time LLM Inference on Standard GPUs: 3k tokens/s per... by blindr on Saturday May 30, 2026 @07:04AM (#48334923)
That's what I tested first and the model failed, even after suggestions that it was wrong and how to fix it's errors.
[ Parent | on HN ]

There are no comments on this comment yet.