News for hackers. Stuff that matters.
Re:Show HN: LLM Inference Calculator – Estimate VRAM, Latenc... by maestroquirk on Friday August 28, 2026 @10:50AM (#49479385)
Need one for vision models too tbh. Token/s doesn't really map easily
Re:Show HN: LLM Inference Calculator – Estimate VRAM, Latenc... by popopanda on Friday August 28, 2026 @12:12PM (#49480662)
Yeah, tokens/s varies a lot based on workload. However, I’ve calibrated the estimator against public benchmarks, so it stays within a 30% error margin!

I'll definitely explore how to estimate vision models next!