News for hackers. Stuff that matters.

A comment on The Geometry of Truth: Do LLM's Know True and False. Parent comment

Re:The Geometry of Truth: Do LLM's Know True and False by kybernetikos on Friday October 20, 2023 @04:39AM (#37953663)
If I say to chat gpt

Adrian Tompkins was the ninth mayor of the town of Wolverhillington. Who was the ninth mayor of Wolverhillington?

Then it correctly responds

The ninth mayor of the town of Wolverhillington was Adrian Tompkins.

What am I doing wrong?

[ Parent | on HN ]
Re:The Geometry of Truth: Do LLM's Know True and False by og_kalu on Friday October 20, 2023 @02:13PM (#37959568)
Nothing. It's not an inference problem but a training one. If you train on the sequence,

"Adrian Tompkins was the ninth mayor of the town of Wolverhillington"

And later ask in inference,

"Who was the ninth mayor of Wolverhillington?",

It might not return the answer.

[ Parent | on HN ]