News for hackers. Stuff that matters.
Re:Understanding ChatGPT by glandium on Sunday March 26, 2023 @07:38AM (#35313376)
Humans can't either, without training data. The biggest difference between chatGPT and humans is that humans are not trained solely on language.
Re:Understanding ChatGPT by rvnx on Sunday March 26, 2023 @07:43AM (#35313410)
I think this is going to change very soon.

Based on the current advances, in about a year we should see the first real-world interaction robot that learns from its environment (probably Tesla or OpenAI).

I'm curious (just leaving it here to see what happens in the future), what will be the excuse of Google this time.

This is again the same situation: Google has supposedly superior tech but not releasing it (or maybe it's as good as Bard...)

Re:Understanding ChatGPT by mchaver on Sunday March 26, 2023 @04:34PM (#35319274)
The important difference is that humans are trained on a lot less data than ChatGPT. This implies that the human brain and LLMs are very different, the human brain likely has a lot of language faculties pre-encoded (this is the main argument of Universal Grammar). OpenAI's GPT 4 is now trained on visual data.

Anyway, I think a lot of ongoing conversations have orthogonal arguments. ChatGPT can be both impressive and generate topics broader than the average human while not giving us deeper insight into how human language works.