Re:Knowledge Is a Region in Weight Space for Fine-Tuned Lang...
by rsfern on Thursday February 23, 2023 @08:31AM
(#34910313)
If your output range is bounded like that then you probably want a sigmoid or tanh activation (with some shifting and scaling maybe) on the output layer. But the hidden layers can still use ReLU without issue
[ Parent
| on HN ]
There are no comments on this comment yet.