News for hackers. Stuff that matters.
Re:"Hallucinating" AIs sound creative, but let's not celebra... by teaearlgraycold on Friday October 13, 2023 @05:02PM (#37875597)
Here's a bit from an episode of This American Life that I think is relevant, cut into a post on my blog:

https://danangell.com/blog/posts/gpt-understands/

> The idea is that back when GPT-4 was being trained for it to really consistently get the next word correct, to do that reliably, it had to do more than just bullshit. It had to do more than guess based on patterns. To get the next word right, it had to truly understand the words coming before it.

Imagine if you were training a transformer to predict numbers in a sequence that came from a sine function. Eventually it would get a pretty good test score and you'd find that internally it had built a decent replication of the sine function.

Now do the same with English text. Throw enough data and computation at it and eventually it'll model a rough understanding of gravity and the shapes of objects, as seen in the different answers between GPT-3.5 and GPT-4.

Re:"Hallucinating" AIs sound creative, but let's not celebra... by thfuran on Friday October 13, 2023 @11:09PM (#37877771)
Does an analog circuit understand differential equations?
Re:"Hallucinating" AIs sound creative, but let's not celebra... by teaearlgraycold on Saturday October 14, 2023 @12:56AM (#37878187)
I think it's not really interesting to say so, but by the same definition it would be fair to describe an analog circuit that models some system as understanding the system in some capacity.

It's more interesting when the thing doing the understanding is a massive system that has both mastered English and other domains and then incidentally modeled some systems English can describe. An analog circuit that models artillery trajectories "understands" one kinematic equation. But that's kind of obvious and mundane. Understanding just one equation barely registers as profound and without that understanding existing in a larger context the word barely seems applicable.