News for hackers. Stuff that matters.
Re:GitHub cuts AI deals with Google, Anthropic by logicchains on Tuesday October 29, 2024 @03:13PM (#41988264)
I don't know how you can say they lack understanding of the world when in pretty much any standardised test designed to measure human intelligence they perform better than the average human. They only thing that don't understand is touch because they're not trained on that, but they can already understand audio and video.
Re:GitHub cuts AI deals with Google, Anthropic by zeknife on Tuesday October 29, 2024 @04:26PM (#41988968)
You said it, those tests are designed to measure human intelligence, because we know that there is a correspondence between test results and other, more general tasks - in humans. We do not know that such a correspondence exists with language models. I would actually argue that they demonstrably do not, since even an LLM that passes every IQ test you put in front of it can still trip up on trivial exceptions that wouldn't fool a child.
Re:GitHub cuts AI deals with Google, Anthropic by esafak on Tuesday October 29, 2024 @10:22PM (#41991361)
So they fail in their own way? They're not humans; that's to be expected.
Re:GitHub cuts AI deals with Google, Anthropic by zeroonetwothree on Tuesday October 29, 2024 @06:11PM (#41989956)
An answer key would outperform the average human but it isn’t intelligent. Tests designed for humans are not appropriate to judge non humans.