News for hackers. Stuff that matters.

A comment on Real-time LLM Inference on Standard GPUs: 3k tokens/s per request. Parent comment

Re:Real-time LLM Inference on Standard GPUs: 3k tokens/s per... by imputation on Friday May 29, 2026 @06:48AM (#48321461)
Everyone beholden to a data center or subject to the installation on the corner of your property of course. Keep up with the times... /s
[ Parent | on HN ]

There are no comments on this comment yet.