News for hackers. Stuff that matters.

A comment on Show HN: I made a GPU VRAM calculator for transformer-based models. Parent comment

Re:Show HN: I made a GPU VRAM calculator for transformer-bas... by ComputerGuru on Tuesday December 26, 2023 @05:22PM (#38776743)
I second the request for quantization, eg for exl2.
[ Parent | on HN ]

There are no comments on this comment yet.