News for hackers. Stuff that matters.
Re:Can I Run AI locally? by J_Shelby_J on Friday March 13, 2026 @02:52PM (#47368145)
It’s a hard problem. I’ve been working on it for the better part of a year.

Well, granted my project is trying to do this in a way that works across multiple devices and supports multiple models to find the best “quality” and the best allocation. And this puts an exponential over the project.

But “quality” is the hard part. In this case I’m just choosing the largest quants.

Re:Can I Run AI locally? by mopierotti on Friday March 13, 2026 @04:57PM (#47369788)
Supporting all the various devices does sound quite challenging.

I wouldn't expect a perfect single measurement of "quality" to exist, but it seems like it could be approximated enough to at least be directionally useful. (e.g. comparing subsequent releases of the same model family)