Re:Every model learned by gradient descent is approximately ...
by kmac_ on Sunday February 25, 2024 @06:23AM
(#39499914)
If you measure knowledge by the number of publications, then LLMs know nothing.
[ Parent
| on HN ]
Re:Every model learned by gradient descent is approximately ...
by vidarh on Sunday February 25, 2024 @08:55AM
(#39500840)
They made the argument he's not a researcher in this field, not that he doesn't know anything. And an LLM is indeed not a researcher in this field either.
Re:Every model learned by gradient descent is approximately ...
by kmac_ on Sunday February 25, 2024 @11:24AM
(#39502069)
It appears that my previous comment lacked clarity. I assumed the inherent absurdity and illogicality of the statement would be self-evident. Dismissing François's opinion, a seasoned professional with extensive expertise in model development and the creator of ARC, solely because he asserts that LLMs are far from achieving AGI and using publication count as the metric for evaluating him is not a well-reasoned argument. While LLMs and transformers are indeed remarkable achievements and will undoubtedly reveal more properties, they have yet to exhibit any true signs of "intelligence."