News for hackers. Stuff that matters.
Re:Knowledge Is a Region in Weight Space for Fine-Tuned Lang... by rsfern on Thursday February 23, 2023 @08:31AM (#34910313)
If your output range is bounded like that then you probably want a sigmoid or tanh activation (with some shifting and scaling maybe) on the output layer. But the hidden layers can still use ReLU without issue

There are no comments on this comment yet.