News for hackers. Stuff that matters.
Re:"Hallucinating" AIs sound creative, but let's not celebra... by danmaz74 on Friday October 13, 2023 @04:25PM (#37875214)
Humans aren't optimized to be correct, but they are optimized to survive and reproduce themselves in the real world. That's why we develop an understanding of the real world, while LLM can, at most, develop an understanding of human language and the constructs that human language can create. But without the napping that we have between that language and our experience of the world.
Re:"Hallucinating" AIs sound creative, but let's not celebra... by happytiger on Friday October 13, 2023 @06:16PM (#37876211)
It gets very interesting when we start providing digital input of analog source data in film, photograph, sound and speech.

We recently started providing perception inputs, just like you’re talking about.

Obviously it’s nascent and not exactly a revolutionary statement, but it’s interesting to see the progression towards our experience.

I’m also interested in how the analog computing revolution is going to converge with AI in coming years, as we are making huge inroads into analog computing and that means cheap ubiquitous sensor inputs right in time for AI to start maturing.

Re:"Hallucinating" AIs sound creative, but let's not celebra... by gaganyaan on Friday October 13, 2023 @08:30PM (#37877041)
LLMs develop a model of the world, experienced through human-generated text. The same as I've never been to China, but I have an internal model of China due to experiencing it through human-generated text.
Re:"Hallucinating" AIs sound creative, but let's not celebra... by danmaz74 on Saturday October 14, 2023 @08:23AM (#37879926)
There is a huge difference between your model and an LLM model in your example. Your model "knows" that China has rivers (of which you have direct experience), coastlines (same), trees, mountains etc. etc. An LLM has no tangible experience of any of the concepts included in the text.
Re:"Hallucinating" AIs sound creative, but let's not celebra... by gaganyaan on Saturday October 14, 2023 @10:09AM (#37880589)
Both my internal model and an LLM are built from sensory data. My model knows what a river is from having experienced it through sensors that an LLM doesn't currently have, but don't expect that limitation to last.

Also, given how many words humans have written describing every part of the experience, LLMs can generate a pretty good understanding of it as-is.

Re:"Hallucinating" AIs sound creative, but let's not celebra... by jshen on Saturday October 14, 2023 @01:21AM (#37878275)
"[humans] are optimized to survive and reproduce ... in the real world."

I think about this difference a lot, and a fair bit of AI/ML attempts to reproduce this process to some degree.