Re:Qwen3 30B A3B Hits 13 token/s on 4xRaspberry Pi 5
by tptacek on Tuesday September 09, 2025 @11:57AM
(#45183861)
Wait, can you say more about how RAG solves this problem? What Kasey is referring to is things like compiling statically-typed code: there's a ground truth an agent is connected to there --- it can at least confidently assert "this code actually compiles" (and thus can't be using an entirely-hallucinated API. I don't see how RAG accomplishes something similar, but I don't think much about RAG.
[ Parent
| on HN ]
There are no comments on this comment yet.