News for hackers. Stuff that matters.

A comment on Hallucination is inevitable: An innate limitation of large language models. Parent comment

Re:Hallucination is inevitable: An innate limitation of larg... by intended on Sunday February 25, 2024 @08:19AM (#39500580)
The fact that a human chooses not to do remember their citations, does not mean they lack the ability.

This argument comes up many times “people don’t do this” - but that is a question of frequency, not whether or not people are capable.

[ Parent | on HN ]
Re:Hallucination is inevitable: An innate limitation of larg... by phh on Sunday February 25, 2024 @09:02AM (#39500889)
LLMs are capable as well if you give them access to the internet though
[ Parent | on HN ]
Re:Hallucination is inevitable: An innate limitation of larg... by Certhas on Sunday February 25, 2024 @09:25AM (#39501057)
Humans did research and remembered sources before the Internet was a thing.

But also, can you give an example where an LLM with access to the Internet can find a primary source?

I don't think learning to refer to sources is something inherently impossible for LLMs, but it is very different to the kind of implicit knowledge they seem to excel at.

[ Parent | on HN ]
Re:Hallucination is inevitable: An innate limitation of larg... by Jensson on Sunday February 25, 2024 @09:07AM (#39500932)
They just paste in the first link then or some other programmed heuristic, they aren't like a human that puts in effort to find something relevant. An LLM with internet access isn't smarter than just asking google search.
[ Parent | on HN ]