News for hackers. Stuff that matters.
Re:Open models by OpenAI by pxc on Tuesday August 05, 2025 @08:03PM (#44806052)
Right... knowledge is one of the things (the one thing?) that LLMs are really horrible at, and that goes double for models small enough to run on normal-ish consumer hardware.

Shouldn't we prefer to have LLMs just search and summarize more reliable sources?

Re:Open models by OpenAI by jdiff on Tuesday August 05, 2025 @08:29PM (#44806260)
Even large hosted models fail at that task regularly. It's a silly anecdotal example, but I asked the Gemini assistant on my Pixel whether [something] had seen a new release to match the release of [upstream thing].

It correctly chose to search, and pulled in the release page itself as well as a community page on reddit, and cited both to give me the incorrect answer that a release had been pushed 3 hours ago. Later on when I got around to it, I discovered that no release existed, no mention of a release existed on either cited source, and a new release wasn't made for several more days.

Re:Open models by OpenAI by nojito on Tuesday August 05, 2025 @08:51PM (#44806407)
Yup which is why these models are so exciting!

They are specifically training on webbrowsing and python calling.

Re:Open models by OpenAI by moodler on Tuesday August 05, 2025 @11:34PM (#44807322)
Reliable sources that are becoming polluted by output from knowledge-poor LLMs, or overwhelmed and taken offline by constant requests from LLMs doing web scraping …