Re:Gated Linear Networks
by currymj on Tuesday June 16, 2020 @01:10PM
(#23541483)
thank you very much for the detailed response!
much to chew on here, it really does seem like a very interesting class of models. from the papers it sounds like in practice clipping weights to a small set works okay, so the constant factors shouldn't be too bad.
i may have to sit down and try to implement these...
much to chew on here, it really does seem like a very interesting class of models. from the papers it sounds like in practice clipping weights to a small set works okay, so the constant factors shouldn't be too bad.
i may have to sit down and try to implement these...