News for hackers. Stuff that matters.
Re:Is artificial consciousness achievable? Lessons from the ... by Conlectus on Sunday May 19, 2024 @10:40AM (#40407284)
Isn’t ReLU an element of neuroscience that was incorporated into machine learning to great success?
Re:Is artificial consciousness achievable? Lessons from the ... by etiam on Sunday May 19, 2024 @06:37PM (#40410273)
Not really, no. That's motivated by not getting impractically small gradients on the plateaus and spoiling the optimization properties when used for deep ANNs. The sigmoids it replaced had a bit more neuroscience inspiration, but so oversimplified it's just barely.