Re:Why Are Eight Bits Enough for Deep Neural Networks?
by tachyonbeam on Sunday September 20, 2015 @03:13AM
(#10246813)
When using 8-bit weights, what kind of mapping do you do? Do you map the 8-bit range into -10 to 10? Do you have more precision near zero or is it a linear mapping?
[ Parent
| on HN ]
Re:Why Are Eight Bits Enough for Deep Neural Networks?
by LoSboccacc on Sunday September 20, 2015 @05:08AM
(#10246979)
Don't know about him but I was working with -8 8 for input and -4 4 for weights, using atan function for transfer maps quite well and there is no need to oversaturate the next layer.