Re:Show HN: LLM-Generated Wikipedia
by tanishqkanc on Monday October 09, 2023 @02:35PM
(#37823635)
Re:Show HN: LLM-Generated Wikipedia
by TernovskiiA on Monday October 09, 2023 @02:49PM
(#37823807)
I am not an expert in LLM implementations, but I don't know if that is something that is necessarily impossible to solve.
In other words, is it an inherent theoretic limitation, or a practical one, and will be solved in time?
Re:Show HN: LLM-Generated Wikipedia
by pk-protect-ai on Tuesday October 10, 2023 @06:02AM
(#37830218)
It is impossible for now. LLMs need external factual information to be kept in check and decrease hallucinations. That is why phind.com is a good approach for improving LLMs quality, bad is that you can't limit search results to the factual only, all related and unrelated trash found by bing and advertised for money will be topped in results.
Re:Show HN: LLM-Generated Wikipedia
by pk-protect-ai on Tuesday October 10, 2023 @06:00AM
(#37830208)
Actually, LLMs can't store 100% accurate factual information, just as our brains can't. All NNs, whether biological or algorithmic, suffer from the same flaw - the probabilistic adjustment of neurons to each other. This is what makes it impossible for the information to be recalled with 100% accuracy.
There are no fundamental limitations in LLM technology that precludes it from having accurate recollection of the facts, isn't that so?