News for hackers. Stuff that matters.
Re:An In-Depth Look at Google's Tensor Processing Unit Archi... by ChuckMcM on Wednesday April 05, 2017 @04:40PM (#14045419)
Almost certainly, and depths would have to increase. Like all series expansions the coefficients on later terms have less and less impact so their dynamic range is less and less important to the final value. But the dynamic range on the initial terms is proportionately important. I expect the dynamic range of the weights will turn out to be logarithmic with respect to overall depth of the network.

There are no comments on this comment yet.