What Is ChatGPT Doing and Why Does It Work?

Re:What Is ChatGPT Doing and Why Does It Work? by saberience on Wednesday February 15, 2023 @04:41AM (#34801771)

The human brain hasn't had to "evolve" to learn writing. Our brain hasn't really changed for many thousands of years and writing has only been around for about 5000 years so we can't use the argument that "human brains have evolved over millions of years to do this" - it's not true.

GPT3 essentially needs millions of human years of data to be able to speak English correctly but still make obvious mistakes to us, so there's clearly something massive still missing.

[ Parent | on HN ]

Re:What Is ChatGPT Doing and Why Does It Work? by eru on Wednesday February 15, 2023 @05:20AM (#34801992)

Writing was specifically designed (by human brains) to be efficiently learnable by human brains.

Same for many other human skills, like speaking English, that we expect GPT to learn.

[ Parent | on HN ]

Re:What Is ChatGPT Doing and Why Does It Work? by scrollaway on Wednesday February 15, 2023 @07:20AM (#34802827)

You are right, as far as we know brains didn’t evolve for writing and language (though there is plenty of evidence that learning to read/write changes the brain). But writing and languages did evolve and adapt FOR humans. They are built to be easy for us; we didn’t care about their mathematical properties.

AI is playing catch up.

[ Parent | on HN ]