Re:Knowledge Is a Region in Weight Space for Fine-Tuned Lang...
by boredumb on Thursday February 23, 2023 @07:47AM
(#34909750)
A 'leaky relu' is used to retain some of the negative stuff and prevent neurons from dying young. I just googled around and now see "PReLU" which seems to also address negative value.
[ Parent
| on HN ]
There are no comments on this comment yet.