popopanda
Re:Show HN: LLM Inference Calculator – Estimate VRAM, Latency, and Thr...
on Friday August 28, 2026 @12:12PM (#49480662)
Yeah, tokens/s varies a lot based on workload. However, I’ve calibrated the estimator against public benchmarks, so it stays within a 30% error margin!
I'll definitely explore how to estimate vision models next!