The bigger-is-better approach to AI is running out of road

Re:The bigger-is-better approach to AI is running out of road by thomasahle on Sunday June 25, 2023 @03:27AM (#36465782)

> An LLM can only ever reproduce what it has seen before.

Anyone who's played around with these models know that at least some generalization is taking place.

[ Parent | on HN ]

Re:The bigger-is-better approach to AI is running out of road by tempodox on Sunday June 25, 2023 @07:45AM (#36467209)

So generalization counts as creativity in your book?

[ Parent | on HN ]

Re:The bigger-is-better approach to AI is running out of road by CamperBob2 on Sunday June 25, 2023 @01:44PM (#36470806)

Inductive reasoning, or the process of inferring from the specific to the general, is kind of a big deal. You can't do that without a semantic model. You can't do it well without a good semantic model... even if it's not something that you or I would recognize as any kind of semantic model at all.

[ Parent | on HN ]

Re:The bigger-is-better approach to AI is running out of road by welshwelsh on Monday June 26, 2023 @11:07AM (#36480581)

Yes, generalization is creativity. I don't think there's a difference between the two concepts.

Humans don't come up with ideas out of nowhere. Open a novel and you will find that even though the overall work is unique, it is composed of tropes from other literature and experiences from the author's life which have been generalized into another context.

[ Parent | on HN ]