Re:Show HN: LLM Inference Calculator – Estimate VRAM, Latenc...
by maestroquirk on Friday August 28, 2026 @10:50AM
(#49479385)
Need one for vision models too tbh. Token/s doesn't really map easily
[ Parent
| on HN ]
Re:Show HN: LLM Inference Calculator – Estimate VRAM, Latenc...
by popopanda on Friday August 28, 2026 @12:12PM
(#49480662)
Yeah, tokens/s varies a lot based on workload. However, I’ve calibrated the estimator against public benchmarks, so it stays within a 30% error margin!
I'll definitely explore how to estimate vision models next!