News for hackers. Stuff that matters.
Re:OpenAI, Google and Anthropic Are Struggling to Build More... by xanderlewis on Thursday November 14, 2024 @05:23PM (#42141849)
Yep. falcor84: you’re thinking of the so-called ‘multilayer perceptron’ which is basically an archaic name for a (densely connected?) neural network. I was referring to traditional perceptrons.
Re:OpenAI, Google and Anthropic Are Struggling to Build More... by falcor84 on Thursday November 14, 2024 @05:51PM (#42142074)
While ReLU is relatively new, AI researchers have been aware of the need for nonlinear activation functions and building multilayer perceptrons with them since the late 1960s, so I had assumed that's what you meant.
Re:OpenAI, Google and Anthropic Are Struggling to Build More... by xanderlewis on Thursday November 14, 2024 @06:31PM (#42142428)
It was a deliberately historical example.