Re:Hardware Architectures for Deep Neural Networks [pdf]
by neolefty on Wednesday September 06, 2017 @11:50AM
(#15184586)
Yes, there are many confounding factors and sources of uncertainty on both sides -- here are a few I can think of:
* memory isn't accounted for
* FLOP per activation is estimated at 100
* neurons can vary by a factor of ~1000 in how much energy they require to activate, based on their size and speed
* ATP: I'm not really sure what to make of the energy here; I used 30kJ / mol. Wikipedia says "The hydrolysis of ATP into ADP and inorganic phosphate releases 30.5 kJ/mol of enthalpy, with a change in free energy of 3.4 kJ/mol."[1] What's the efficiency of our digestive & recharging systems -- maybe 5% - 30%?
* memory isn't accounted for
* FLOP per activation is estimated at 100
* neurons can vary by a factor of ~1000 in how much energy they require to activate, based on their size and speed
* ATP: I'm not really sure what to make of the energy here; I used 30kJ / mol. Wikipedia says "The hydrolysis of ATP into ADP and inorganic phosphate releases 30.5 kJ/mol of enthalpy, with a change in free energy of 3.4 kJ/mol."[1] What's the efficiency of our digestive & recharging systems -- maybe 5% - 30%?
https://en.wikipedia.org/wiki/Adenosine_triphosphate