Re:Google supercharges machine learning tasks with TPU custo...
by agumonkey on Wednesday May 18, 2016 @04:10PM
(#11725449)
That was my impression too. ML under the hood was a lot of linear algebra, not very different than most shaders. But maybe Google decided to hardcode a few important ML primitives because the ROI was that good in terms of grabbing customers. Also they might have very large scale applications not found elsewhere that motivates this.
[ Parent
| on HN ]
Re:Google supercharges machine learning tasks with TPU custo...
by azinman2 on Wednesday May 18, 2016 @05:16PM
(#11726037)
Ok I was obviously oversimplifying things but my point is since we can only speculate, it's clear that when you know specific algorithms/math operations/memory layouts/applications you want to optimize for you can create dedicated chips that optimize and do that quickly. That bitcoin miners are all dedicated chips and run circles around GPUs demonstrates exactly this fact.
Furthermore the fact that ML can be error tolerant means you also get to optimize certain floating point operations for speed or energy efficiency at the cost of accuracy. NVIDIA doesn't get to do this in their linear algebra support.
Re:Google supercharges machine learning tasks with TPU custo...
by vintermann on Thursday May 19, 2016 @02:19AM
(#11728385)
Bitcoin mining is an extremely well-defined task compared to machine learning. It remains to be seen how general these TPUs are in practice - whether they will support the neural network architectures common two years from now.