News for hackers. Stuff that matters.
Re:GPU Memory Math for LLMs: Formula That Tells You What Fit... by DiabloD3 on Wednesday May 20, 2026 @06:44PM (#48215325)
This isn't very useful.

V of context is not equal across models.

Also, huggingface tells you how big the model is for the exact one you have in your hand, why the weird guesswork? Dynamic quants are not going to magically fit some formula.

There are no comments on this comment yet.