Re:Building your own deep learning computer is 10x cheaper t...
by oneshot908 on Friday September 28, 2018 @04:47PM
(#18096928)
Sure, that's a nice approximation, and it will reduce performance somewhat IMO, it'd be nice to quantify how much, no?
You will want to use hierarchical outputs in this case. Take a look at Hinton's 'Knowledge Distillation' paper.