News for hackers. Stuff that matters.
Re:Why is so much memory needed for deep neural networks? by dnautics on Thursday March 23, 2017 @04:21AM (#13938114)
If my understanding is correct, FPGAs aren't that fast, and while the really small ones are cheap, they don't fit that much. I synthesized a 32-bit multiplier on a spartan 6, and it took up about 1/5 of the footprint. I figure maybe you could fit 4 16-bit fused-multiply adds (which ought to be able to do machine learning) onto a spartan 6, which is not that great.

What is really going to slaughter you for ML performance on FPGAs is memory bandwidth.

If you have access to a really big FPGAs with lots of memory (on the order of $10-30k...) it might make a difference.

Re:Why is so much memory needed for deep neural networks? by jacquesm on Thursday March 23, 2017 @08:00AM (#13938990)
I'd see more applications on the evaluation than on the training side but even in training there might be a few situations where it could pay off, you'd still be stuck with a huge communications issue to solve.