Re:Techniques for Training Large Neural Networks
by eismcc on Thursday June 09, 2022 @03:19PM
(#31685591)
Has anyone tried using another NN as the “gradient” function? With the hope of making it less “blind?”
[ Parent
| on HN ]
Re:Techniques for Training Large Neural Networks
by rolisz on Thursday June 09, 2022 @04:13PM
(#31686184)
DeepMind has a thing called synthetic gradients: https://www.deepmind.com/blog/decoupled-neural-interfaces-us....