Re:Knowledge Is a Region in Weight Space for Fine-Tuned Lang...
by bilsbie on Thursday February 23, 2023 @07:28AM
(#34909577)
Why is it good to ignore values less than zero?
[ Parent
| on HN ]
Re:Knowledge Is a Region in Weight Space for Fine-Tuned Lang...
by wcoenen on Thursday February 23, 2023 @12:37PM
(#34913728)
Intuitively it makes sense that certain nodes only "activate" when the concept/feature that they have learned is actually present in the input.
(Whether this is the correct interpretation, I'm not sure.)