News for hackers. Stuff that matters.
Re:Can I Run AI locally? by philipkglass on Friday March 13, 2026 @10:39PM (#47372745)
Qwen 3 and 3.5 models are quite capable. Perhaps the greatest benefit of GLM-OCR is speed: it's only a 0.9 billion parameter model, so it's fast enough to run on large volumes of complicated scans even if all you have for inference is an entry level MacBook or a low end Nvidia card. Even CPU based inference on basic laptops is probably tolerable with it for small page volumes.

There are no comments on this comment yet.