News for hackers. Stuff that matters.
Re:Google supercharges machine learning tasks with TPU custo... by emcq on Wednesday May 18, 2016 @10:14PM (#11727475)
If they balance compute to memory better than GPUs, you could definitely see a 10x. GPUs have large off chip memory and small caches (like 256kb). Cost to going to off chip memory can be 1-2 orders of magnitude more than on chip memory. You can certainly fit 4+MB on modern processors, but they likely bought designs from a company like Samsung because designing high performance, low power memory cells is tricky. I'm surprised they were able to keep things a secret.

There are no comments on this comment yet.