News for hackers. Stuff that matters.
Re:Knowledge Is a Region in Weight Space for Fine-Tuned Lang... by p1esk on Friday February 24, 2023 @01:22PM (#34927859)
Almost no one uses ReLU anymore. It's usually GeLU for llms, and Swish for images.

There are no comments on this comment yet.