News for hackers. Stuff that matters.

A comment on Geoffrey Hinton leaves Google and can now speak freely about his AI concern. Parent comment

Re:Geoffrey Hinton leaves Google and can now speak freely ab... by TeMPOraL on Monday May 01, 2023 @07:42PM (#35780913)
Maybe not "looked down on", but more of "looked at as a promising avenue". I mean, 2-3 years ago, it felt LLMs are going to be nice storytellers at best. These days, we're wondering just how much of the overall process of "understanding" and "reasoning" can be reduced to adjacency search in sufficiently absurdly high-dimensional vector space.
[ Parent | on HN ]
Re:Geoffrey Hinton leaves Google and can now speak freely ab... by whimsicalism on Monday May 01, 2023 @07:44PM (#35780947)
People certainly knew that language modeling was a key unsupervised objective to unlock inference on language.

I agree that I think they underestimated quite how useful a product could be built around just the language modeling objective, but it's still been critical for most NLP advances of the last ~6+ years.

[ Parent | on HN ]