News for hackers. Stuff that matters.

A comment on Google scrambles to manually remove weird AI answers in search. Parent comment

Re:Google scrambles to manually remove weird AI answers in s... by duskwuff on Saturday May 25, 2024 @05:38PM (#40478070)
Can you cite a source for this, or are you speculating?

My understanding was the opposite -- that the activity of a confabulating LLM is indistinguishable from one giving factually accurate responses.

https://arxiv.org/abs/2401.11817

[ Parent | on HN ]
Re:Google scrambles to manually remove weird AI answers in s... by astrange on Saturday May 25, 2024 @06:26PM (#40478293)
Some things like:

https://arxiv.org/abs/2310.18168

https://arxiv.org/abs/2310.06824

There are various reasons an LLM might have incorrect "beliefs" - the input text was false, training doesn't try to preserve true beliefs, quantization certainly doesn't. So it can't be perfectly addressed, but some things leading to it seem like they can be found.

> https://arxiv.org/abs/2401.11817

This seems like it's true since LLMs are a finite size, but in Google's case it has a "truth oracle" (the websites it's quoting)… the problem is it's a bad oracle.

[ Parent | on HN ]