Re:OpenAI, Google and Anthropic Are Struggling to Build More...
by xanderlewis on Thursday November 14, 2024 @05:23PM
(#42141849)
Yep. falcor84: you’re thinking of the so-called ‘multilayer perceptron’ which is basically an archaic name for a (densely connected?) neural network. I was referring to traditional perceptrons.
[ Parent
| on HN ]
Re:OpenAI, Google and Anthropic Are Struggling to Build More...
by falcor84 on Thursday November 14, 2024 @05:51PM
(#42142074)
While ReLU is relatively new, AI researchers have been aware of the need for nonlinear activation functions and building multilayer perceptrons with them since the late 1960s, so I had assumed that's what you meant.
Re:OpenAI, Google and Anthropic Are Struggling to Build More...
by xanderlewis on Thursday November 14, 2024 @06:31PM
(#42142428)
It was a deliberately historical example.