News for hackers. Stuff that matters.
Re:Local LLMs versus Offline Wikipedia by latexr on Sunday July 20, 2025 @05:52AM (#44623472)
Sounds like a good way to ensure society never “reboots”.

A “frozen snapshot” of reliable knowledge is infinitely more valuable than a system which gives you wrong instructions and you have no idea what action will work or kill you. Anyone can “explain complex ideas in simple terms” if you don’t have to care about being correct.

What kind of scenario is this, even? We had such a calamity that we need to “reboot” society yet still have access to all the storage and compute power required to run LLMs? It sounds like a doomsday prepper fantasy for LLM fans.

Re:Local LLMs versus Offline Wikipedia by ACCount36 on Sunday July 20, 2025 @07:43AM (#44624229)
Currently, there are billions of devices that are capable of storing and running a 4B LLM locally. Hundreds of millions for 32B LLMs. It would take an awful lot of effort to destroy all of that.

If you're doomsday prepping, there's no reason not to have both. They're complimentary. Wikipedia is more reliable, but also much more narrow in its knowledge, and can't talk back. Just the "point someone who doesn't know what he's dealing with in a somewhat sensible direction" is an absolute killer feature that LLMs happen to have.

Re:Local LLMs versus Offline Wikipedia by latexr on Monday July 21, 2025 @03:57AM (#44632763)
> It would take an awful lot of effort to destroy all of that.

It would take even more to reach a state of having to “reboot civilisation”, which is the premise we’re discussing.