News for hackers. Stuff that matters.
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by Karunamon on Wednesday March 15, 2023 @05:29PM (#35174985)
Interesting analogy… Actually a damn good one because I'm having a hard time finding how it leaks :)

I have to ask what definition(s) of intelligence we are using here. There are multiple, and GPT satisfies some to some degree but not others. Emotion and self-awareness can probably be written off entirely. Some experimenting shows that it still sucks at logic when presented with a pristine problem (something that definitely is not in its training set); and I would say this is a requirement of a general intelligence, being able to take the knowledge it has and speculatively applying that to things it has no knowledge of using induction/deduction.

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by PartiallyTyped on Thursday March 16, 2023 @05:48AM (#35179947)
As I have said in a parallel chain, ChatGPT has been able to solve programming assignments for 15-17 year olds written in Greek. The P it has seen those tasks in Greek before is approaching zero imho.

> being able to take the knowledge it has and speculatively applying that to things it has no knowledge of using induction/deduction.

One could argue that its 'confidence' is an example of speculatively applying what it knows. The problem is that the inference machinery behind it is quite weak.