News for hackers. Stuff that matters.
Re:Local LLMs versus Offline Wikipedia by rlupi on Sunday July 20, 2025 @02:39AM (#44622534)
This gave me a nice idea.

It would be nice to build a local LLM + wikipedia tool, that uses the LLM to assemble a general answer and then search wikipedia (via full-text search or rag) for grounding facts. It could help with hallucinations of small models a lot.

Re:Local LLMs versus Offline Wikipedia by Tempat1 on Sunday July 20, 2025 @02:49AM (#44622571)
I feel like there could be way more of that kind of thing - LLMs backed by a database of info or accurate tools.

e.g. At the risk of massively oversimplifying a complex issue, LLMs are bad at maths; couldn’t we have them use the calculator?

Re:Local LLMs versus Offline Wikipedia by rlupi on Monday July 21, 2025 @02:48AM (#44632395)
LLM tools do exactly that. That's why most online LLMs (openai, gemini) have access to sandboxed python for calculations.