News for hackers. Stuff that matters.

A comment on GPU Memory Math for LLMs: Formula That Tells You What Fits on Your GPU.

Re:GPU Memory Math for LLMs: Formula That Tells You What Fit... by metadat on Wednesday May 20, 2026 @05:48PM (#48214651)
This is super useful. Most of the time I go to run a model off Hugging Face on my 64GB MBP I run into issues where I drastically overestimated what it could do. :>
[ Parent | on HN ]

There are no comments on this comment yet.