News for hackers. Stuff that matters.

A comment on Microsoft researchers developed a hyper-efficient AI model that can run on CPUs. Parent comment

Re:Microsoft researchers developed a hyper-efficient AI mode... by imtringued on Thursday April 17, 2025 @02:17AM (#43713643)
AQLM, EfficientQAT and ParetoQ get reasonable benchmark scores at 2-bit quantization. At least 90% of the original unquantized scores.
[ Parent | on HN ]

There are no comments on this comment yet.