News for hackers. Stuff that matters.
Re:"Hallucinating" AIs sound creative, but let's not celebra... by gaganyaan on Friday October 13, 2023 @08:30PM (#37877041)
LLMs develop a model of the world, experienced through human-generated text. The same as I've never been to China, but I have an internal model of China due to experiencing it through human-generated text.
Re:"Hallucinating" AIs sound creative, but let's not celebra... by danmaz74 on Saturday October 14, 2023 @08:23AM (#37879926)
There is a huge difference between your model and an LLM model in your example. Your model "knows" that China has rivers (of which you have direct experience), coastlines (same), trees, mountains etc. etc. An LLM has no tangible experience of any of the concepts included in the text.
Re:"Hallucinating" AIs sound creative, but let's not celebra... by gaganyaan on Saturday October 14, 2023 @10:09AM (#37880589)
Both my internal model and an LLM are built from sensory data. My model knows what a river is from having experienced it through sensors that an LLM doesn't currently have, but don't expect that limitation to last.

Also, given how many words humans have written describing every part of the experience, LLMs can generate a pretty good understanding of it as-is.