Re:Hardware Architectures for Deep Neural Networks [pdf]
by deepnotderp on Wednesday September 06, 2017 @11:04AM
(#15184222)
Well, keep in mind that you should never really use the advertised number as your comparison point, because that's more the "highest that you'll ever see" rather than the "average reliable performance". Not to mention they assume everything magically is in the caches as far as memory is concerned, which is absolutely untrue.
[ Parent
| on HN ]
Re:Hardware Architectures for Deep Neural Networks [pdf]
by neolefty on Wednesday September 06, 2017 @11:50AM
(#15184586)
Yes, there are many confounding factors and sources of uncertainty on both sides -- here are a few I can think of:
* memory isn't accounted for
* FLOP per activation is estimated at 100
* neurons can vary by a factor of ~1000 in how much energy they require to activate, based on their size and speed
* ATP: I'm not really sure what to make of the energy here; I used 30kJ / mol. Wikipedia says "The hydrolysis of ATP into ADP and inorganic phosphate releases 30.5 kJ/mol of enthalpy, with a change in free energy of 3.4 kJ/mol."[1] What's the efficiency of our digestive & recharging systems -- maybe 5% - 30%?