News for hackers. Stuff that matters.

A comment on Real-time LLM Inference on Standard GPUs: 3k tokens/s per request. Parent comment

Re:Real-time LLM Inference on Standard GPUs: 3k tokens/s per... by bcjdjsndon on Friday May 29, 2026 @10:09AM (#48323318)
> Did you expect a single GPU chip to reach 3k tps?

Did the article headline not say Standard GPU?

[ Parent | on HN ]

There are no comments on this comment yet.