Hallucination is inevitable: An innate limitation of large language models

Re:Hallucination is inevitable: An innate limitation of larg... by beardedwizard on Monday February 26, 2024 @09:52PM (#39519598)

I understand physics because science has performed a series of measurable experiments over 100s of years resulting in concrete mathematical formulas and theories that explain the laws of physics so that they can be reproduced by machines.

Sora has zero of this knowledge. This is very much allegory of the cave[1].

If Sora sees a series of images that contain impossible physics, for example MC Escher paintings, what will happen?

1: https://en.wikipedia.org/wiki/Allegory_of_the_cave

[ Parent | on HN ]

Re:Hallucination is inevitable: An innate limitation of larg... by ninetyninenine on Tuesday February 27, 2024 @12:50AM (#39520580)

Sora understands basic motion without mathematics in the same way people typically understand physics.

A person with no knowledge about mathematical formulas will still be able to recognize impossible MC Escher paintings. With enough data, Sora will be able to generate both impossible and possible physics and know the difference. We can already see in the video that it has a rough understanding of it.

[ Parent | on HN ]