How Does GPT Obtain Its Ability? Tracing Emergent Abilities of Language Models

Re:How Does GPT Obtain Its Ability? Tracing Emergent Abiliti... by kewp on Thursday December 15, 2022 @07:53AM (#33998764)

Isn't it possible that intelligence is P(words|every sequence of words you've ever heard)?

[ Parent | on HN ]

Re:How Does GPT Obtain Its Ability? Tracing Emergent Abiliti... by Eliezer on Thursday December 15, 2022 @07:59AM (#33998843)

Then where would sensible words come from, for the first time, in hominid history?

[ Parent | on HN ]

Re:How Does GPT Obtain Its Ability? Tracing Emergent Abiliti... by rthomas6 on Thursday December 15, 2022 @09:16AM (#33999801)

P(sounds when object is present|random sounds other people made when object was present) ?

[ Parent | on HN ]

Re:How Does GPT Obtain Its Ability? Tracing Emergent Abiliti... by joshuahedlund on Thursday December 15, 2022 @08:27AM (#33999175)

No, you’re conflating System 1 thinking and System 2 thinking.

[ Parent | on HN ]

Re:How Does GPT Obtain Its Ability? Tracing Emergent Abiliti... by oliveshell on Thursday December 15, 2022 @07:58AM (#33998815)

Possible? Maybe. I believe we know enough now, however, to conclude that it’s astonishingly unlikely.

[ Parent | on HN ]