This isn't true. Running neural networks (including CNNs) can be computationally and power intensive, and lends itself to the vector operations of GPUs, FPGAs, and ASICs. Putting the computations on devoted hardware could enable embedded applications that simply aren't possible otherwise.
Here's a whitepaper by Microsoft about using FPGA's to speed up CNNs: http://research.microsoft.com/apps/pubs/?id=240715
Article by Google explaining the importance of optimizing neural networks to run on mobile phones: http://googleresearch.blogspot.com/2015/07/how-google-transl...
Have you played with Apple Accelerate? They've been baking this stuff into their chips for quite some time. Apple's FFT outperforms FFTW. https://developer.apple.com/library/mac/navigation/#section=...
I see one example in Verilog on github: https://github.com/ziyan/altera-de2-ann/blob/master/src/ann/...
(For example, Google's voice recognition on Android can run when offline.)
What happens when 1000 of these are plugged in to 1000 drones and they all communicate? I don't know enough to even guess but perhaps something interesting and dangerous?
Sometimes training is done on the customer site. For example a noise cancellation algorithm may learn audio characteristics of the user's environment to offer better performance.
Acceleration is needed for training -- not running the models themselves. A quick glimpse of the power used (1 watt) lets you know exactly how much "acceleration" is going on in here. This is meant for tiny devices.
EDIT: My point is that this is a small-run dev board for a chip for some future $19 nannycam. It's not an "accelerator" you install on your PC to put your graphics card to shame running TensorFlow.
EDIT #2: This is another one of those HN threads that's overrun by enthusiasts. Jamming a chip onto a stick is simply how they sell embedded crap now.
Here's a crypto chip that'll really get you guys going: http://www.atmel.com/tools/AT88CK590.aspx