News for hackers. Stuff that matters.
Re:Knowledge Is a Region in Weight Space for Fine-Tuned Lang... by boredumb on Thursday February 23, 2023 @07:47AM (#34909750)
A 'leaky relu' is used to retain some of the negative stuff and prevent neurons from dying young. I just googled around and now see "PReLU" which seems to also address negative value.

There are no comments on this comment yet.