News for hackers. Stuff that matters.

A comment on Project Nomad – Knowledge That Never Goes Offline. Parent comment

Re:Project Nomad – Knowledge That Never Goes Offline by Schlagbohrer on Monday March 23, 2026 @08:39AM (#47488653)
Even with that setup I have unfortunately had a bad experience just using Qwen2.5-27B. I asked it once to take a large PDF of a book and find and quote all instances which mentioned food. After churning for a long time it eventually gave me several interesting excerpts, only one of which was real and the rest were hallucinations/confabulations.

I hope we can get to the point where even a small distilled model at the 7B-30B level avoids hallucinating.

[ Parent | on HN ]
Re:Project Nomad – Knowledge That Never Goes Offline by nullsmack on Wednesday March 25, 2026 @05:08PM (#47523299)
Qwen2.5 is quite old at this point. The new Qwen3.5 series is good, and it has a 27b dense model too. I have to watch it but I've gotten surprising results out of the 4b model even. They're also vision enabled and pretty good at ocr. These were released in just the last few weeks.
[ Parent | on HN ]