News for hackers. Stuff that matters.
Re:Deep Learning and Free Software by tree_of_item on Thursday July 26, 2018 @11:08AM (#17618046)
People keep saying it's "not feasible" to do deep learning on a CPU. Is that actually true? I'm thinking of papers like this one[0] from Uber. that make the claim that CPU training is very much feasible, in this case with a cluster of 10 machines, each with 72~ CPUs. There's a blog post about someone recreating the paper here[1].

Sure, you can't do it on ONE CPU, but the point is to have a cluster of CPUs. It's not the case that you're forced to use nVidia's proprietary stuff in order to do deep learning.

[0]: https://arxiv.org/abs/1712.06567 [1]: https://towardsdatascience.com/paper-repro-deep-neuroevoluti...

Re:Deep Learning and Free Software by gnufx on Thursday July 26, 2018 @04:41PM (#17620864)
Re:Deep Learning and Free Software by blt on Thursday July 26, 2018 @04:39PM (#17620834)
It's definitely feasible and widely used for reinforcement learning on low dimensional systems, where the neural networks are small and the simulator is more expensive than backprop. On other hand, deep Q learning from pixels on Atari is practically impossible without GPUs.
Re:Deep Learning and Free Software by tree_of_item on Thursday July 26, 2018 @08:05PM (#17622442)
Huh? I just showed you reinforcement learning from pixels on Atari with CPU...