How Does GPT Obtain Its Ability? Tracing Emergent Abilities of Language Models

Re:How Does GPT Obtain Its Ability? Tracing Emergent Abiliti... by resource0x on Wednesday December 14, 2022 @08:15PM (#33993624)

I see. The assumption here is that one can simulate intelligence without formalizing the notion of meaning. (And if "meaning" is not defined, then the notion of "truth" is impossible to define either). Is my understanding correct?

[ Parent | on HN ]

Re:How Does GPT Obtain Its Ability? Tracing Emergent Abiliti... by int_19h on Wednesday December 14, 2022 @08:26PM (#33993747)

The assumption here is that one can produce useful outputs in this manner. Whether it constitutes "simulating intelligence" is a philosophical question.

[ Parent | on HN ]

Re:How Does GPT Obtain Its Ability? Tracing Emergent Abiliti... by skybrian on Wednesday December 14, 2022 @09:07PM (#33994146)

Some people hope that training will cause it to represent meanings somehow. How to represent meaning isn't well understood.

[ Parent | on HN ]