News for hackers. Stuff that matters.
Re:OpenAI cofounder Ilya Sutskever says the way AI is built ... by signa11 on Saturday December 14, 2024 @10:38AM (#42417737)
sorry, but i think neural-networks came way before 2012, notably the works of rumelhart, mccleland etc. see the 2 volume "parallel distributed processing" to read almost all about it.

the book(s): https://direct.mit.edu/books/monograph/4424/Parallel-Distrib...

a-talk: https://www.youtube.com/watch?v=yQbJNEhgYUw

Re:OpenAI cofounder Ilya Sutskever says the way AI is built ... by FL33TW00D on Saturday December 14, 2024 @12:06PM (#42418194)
I raise you Warren McCulloch in 1962: https://www.youtube.com/watch?v=wawMjJUCMVw
Re:OpenAI cofounder Ilya Sutskever says the way AI is built ... by mcshicks on Saturday December 14, 2024 @11:10AM (#42417888)
Re:OpenAI cofounder Ilya Sutskever says the way AI is built ... by martindbp on Saturday December 14, 2024 @02:39PM (#42418969)
I knew someone would bring it up, which is why I added "(yes, NNs are old, but 2012 was the start of the deep learning revolution)"
Re:OpenAI cofounder Ilya Sutskever says the way AI is built ... by versteegen on Saturday December 14, 2024 @05:50PM (#42420043)
2012 was when the revolutionaries stormed the bastille and overthrew the old guard. But I say it was 2006 when the revolution started, when the manifesto was published: deep NNs can be trained end-to-end, learning their own features [1]. I think this is when "Deep Learning" became a term of art, and the paper has 24k citations. (Interestingly in a talk a Vector Hinton gave two weeks ago he said his paper on deep learning at NIPS 2006 was rejected because they already had one.)

[1] G. E. Hinton and R. R. Salakhutdinov, 2006, Science, Reducing the Dimensionality of Data with Neural Networks