Re:Real-time LLM Inference on Standard GPUs: 3k tokens/s per...
by embedding-shape on Friday May 29, 2026 @07:27AM
(#48321757)
Do you think maybe changing your articles title from "Real-time LLM Inference on Standard GPUs" to "Real-time LLM Inference on Standard Datacenter GPUs" might make sense here? Given more people seem confused by the title than not, and you could clear this up relatively easily, at least on your website although might be late to fix the HN title.
Re:Real-time LLM Inference on Standard GPUs: 3k tokens/s per...
by gaeld on Friday May 29, 2026 @07:37AM
(#48321846)
YES - I just updated the title of our article according to your suggestion.
Re:Real-time LLM Inference on Standard GPUs: 3k tokens/s per...
by irishcoffee on Friday May 29, 2026 @07:35AM
(#48321831)
Oh, it isn't confusing, it is misleading. A standard GPU lets you connect a monitor. A datacenter GPU lets you do headless math.
Re:Real-time LLM Inference on Standard GPUs: 3k tokens/s per...
by gaeld on Friday May 29, 2026 @07:38AM
(#48321851)
I updated the article title accordingly
Re:Real-time LLM Inference on Standard GPUs: 3k tokens/s per...
by bcjdjsndon on Friday May 29, 2026 @10:15AM
(#48323395)
Standard != Datacentre
Sorry for the confusion