For what it's worth, Cori http://www.nersc.gov/users/data-analytics/data-analytics-2/d... claimed 15 PF https://arxiv.org/pdf/1708.05256.pdf
It's definitely feasible and widely used for reinforcement learning on low dimensional systems, where the neural networks are small and the simulator is more expensive than backprop. On other hand, deep Q learning from pixels on Atari is practically impossible without GPUs.
Re:Deep Learning and Free Software
by tree_of_item on Thursday July 26, 2018 @08:05PM
(#17622442)
Huh? I just showed you reinforcement learning from pixels on Atari with CPU...
Sure, you can't do it on ONE CPU, but the point is to have a cluster of CPUs. It's not the case that you're forced to use nVidia's proprietary stuff in order to do deep learning.
[0]: https://arxiv.org/abs/1712.06567 [1]: https://towardsdatascience.com/paper-repro-deep-neuroevoluti...