Re:OpenAI cofounder Ilya Sutskever says the way AI is built ...
by zitterbewegung on Saturday December 14, 2024 @10:43AM
(#42417764)
Neural Networks are 200 years old (Legendre and Gauss defined Feed forward neural networks). Deep learning. The real difference between traditional ones and deep learning is a hierarchy of layers (hidden layers) which do different things to accomplish a goal. Even the concept of training is to provide weights on the neural network and there are many algorithms to do refinement, optimization and the network design.
[ Parent
| on HN ]
Re:OpenAI cofounder Ilya Sutskever says the way AI is built ...
by varjag on Saturday December 14, 2024 @11:48AM
(#42418098)
Gauss did not define feed forward neural networks, it all stems from a tweet of a very confused person.
Re:OpenAI cofounder Ilya Sutskever says the way AI is built ...
by mrbungie on Saturday December 14, 2024 @02:01PM
(#42418790)
I mean, sure, you can model a simple linear regression fitted via Least Squares (pretty much what they did 200 years ago) with a one hidden layer feed-fwd Neural Network, but the theorical framework for NNs is quite different.
Re:OpenAI cofounder Ilya Sutskever says the way AI is built ...
by hervature on Saturday December 14, 2024 @10:47PM
(#42421313)
For Least Squares, you do not even use a hidden layer. Just a single dense layer from input directly to output. You also do not use an activation function (or use the identity activation function). That is, everything that makes neural networks special.