Re:Unum Computing: An Energy Efficient and Massively Paralle...
by dnautics on Friday July 24, 2015 @05:22PM
(#9945276)
Agreed. For neural networks. I would argue the opposite is true, you should just have a 16bit float that casts really large values to infinity silently without throwing errors, with a logistic lookup that maps "inf" to +/- 1... A mathematically incorrect float is operationally superior to the correct one.
Re:Unum Computing: An Energy Efficient and Massively Paralle...
by methodOverdrive on Saturday July 25, 2015 @06:46PM
(#9949343)
Bonus points if values near 0 are treated as 0 (encourages sparsity!)
Re:Unum Computing: An Energy Efficient and Massively Paralle...
by GFK_of_xmaspast on Friday July 24, 2015 @07:23PM
(#9945828)
For hardware without a FPU, you can do floats in software when accuracy is more important than speed (vs fixed point), one can imagine that if this thing actually works then for hardware without a "UPU" one can just do unums in software when needed.
They're also an inferior replacement in the case that you want to take advantage of highly-optimized hardware, and that getting a correct answer doesn't really matter. I don't see unums replacing floats for, say, video game graphics. But for numerical computation, it seems like the only real flaw with unums compared to doubles is the nonexistence of a hardware implementation, and the existing popularity of doubles.