Re:Geoffrey Hinton leaves Google and can now speak freely ab...
by jxmorris12 on Monday May 01, 2023 @10:11AM
(#35772998)
This may be true in other cases, but not here. Hinton literally wrote the paper on backpropagation, the way that modern neural networks are trained. He won the Turing award for a reason.
[ Parent
| on HN ]
Re:Geoffrey Hinton leaves Google and can now speak freely ab...
by UncleMeat on Monday May 01, 2023 @10:13AM
(#35773041)
Hinton was critical for the development of ai. But was he critical for the development of openai, the company? Loads of startups get eminent people on their boards largely for advertising.
Re:Geoffrey Hinton leaves Google and can now speak freely ab...
by Fricken on Monday May 01, 2023 @10:25AM
(#35773190)
Hinton's protege Ilya Sutskever has been critical to Open AI's success.
Re:Geoffrey Hinton leaves Google and can now speak freely ab...
by jstx1 on Monday May 01, 2023 @10:35AM
(#35773335)
Has he contributed that much personally? I thought a lot of the success of ChatGPT is some good ideas from lower ranked researchers + great engineering.
Re:Geoffrey Hinton leaves Google and can now speak freely ab...
by parthdesai on Monday May 01, 2023 @10:41AM
(#35773408)
He is the co-founder and chief scientist[0] at OpenAI but "has he contributed that much personally". I don't even know how to respond to that
Re:Geoffrey Hinton leaves Google and can now speak freely ab...
by jstx1 on Monday May 01, 2023 @12:02PM
(#35774759)
I asked the question knowing that he's a co-founder and chief scientist at OpenAI. Being in his position doesn't automatically mean that he's contributed meaningfully.
Re:Geoffrey Hinton leaves Google and can now speak freely ab...
by shadowgovt on Monday May 01, 2023 @02:22PM
(#35776955)
It's a bit in the category of "When you consider all factors, how important was Isaac Newton's work to Einstein's discoveries?"
Re:Geoffrey Hinton leaves Google and can now speak freely ab...
by thomasahle on Monday May 01, 2023 @11:12AM
(#35773927)
My experience in "Applied Research" is that often "good ideas from lower ranked researchers" (or good ideas from anyone really) is "I saw this cool paper, let's try and implement that". That doesn't mean top people like Hinton should get all the credit, but let's not kid ourselves and believe most of the ideas didn't origin in academia.
One of GOpenAI's recent breakthroughs was switching to FlashAttention, invented at Stanford and University at Buffalo.
Re:Geoffrey Hinton leaves Google and can now speak freely ab...
by lostmsu on Monday May 01, 2023 @04:00PM
(#35778325)
Isn't Hinton's paper on backprop just a "let's try to implement that" for a multilayer network?
Re:Geoffrey Hinton leaves Google and can now speak freely ab...
by thomasahle on Monday May 01, 2023 @05:18PM
(#35779312)
I'm not going to claim Hinton "invented backprop". He even says he didn't himself: https://www.reddit.com/r/MachineLearning/comments/g5ali0/com...