News for hackers. Stuff that matters.
Re:AI could be the end of the digital wave, not the next big... by theshrike79 on Wednesday April 15, 2026 @06:09AM (#47776978)
Yea, it's not an encyclopedia of facts. Language models store the FEELS of the data in vectors (or angles in Gemma4's case, it's a cool thing) not the exact string.

But what you can do with local models is give them actual data and tools to search it. Download a copy of Wikipedia locally, give the agent a way to search it and BOOM accurate information without an internet connection.

Also "small enough to live on disk" is a bit vague, especially when models get super stupid super fast when you get to the smaller size. At that point they're just basically 40k servitors that can use tools and nothing much.

There are no comments on this comment yet.