Re:Is artificial consciousness achievable? Lessons from the ...
by Conlectus on Sunday May 19, 2024 @10:40AM
(#40407284)
Isn’t ReLU an element of neuroscience that was incorporated into machine learning to great success?
[ Parent
| on HN ]
Re:Is artificial consciousness achievable? Lessons from the ...
by etiam on Sunday May 19, 2024 @06:37PM
(#40410273)
Not really, no. That's motivated by not getting impractically small gradients on the plateaus and spoiling the optimization properties when used for deep ANNs.
The sigmoids it replaced had a bit more neuroscience inspiration, but so oversimplified it's just barely.