News for hackers. Stuff that matters.
Re:Benchmarking TensorFlow on Cloud CPUs: Cheaper Deep Learn... by asah on Sunday July 09, 2017 @02:08AM (#14728591)
Just signed up and ported my model + data: - it's indeed noticeably faster than the Google VMs. As usual, I compiled tensorflow for this GPU vs K80 (feature 6.1 vs 3.7). - ubuntu 16 minimal is indeed "minimal" ! but it worked... - GTX 1080 (7.92GB) has less GPU RAM than the K80 (11.17GiB) - this required me to reduce the model design slightly.

For my model/data, Hetzner runs 1 training epoch in 1 hr vs 1.75 hr for Google. I'm moving the rest of my work over tomorrow. When Google has TPUs available, I'll look at it again.

thanks!! for the tip.

Re:Benchmarking TensorFlow on Cloud CPUs: Cheaper Deep Learn... by boulos on Sunday July 09, 2017 @03:25AM (#14728759)
This is presumably just the full board versus half nomenclature noted above. But yes, consumer GPUs are way more cost competitive than Tesla class parts. Being able to train bigger models is valuable to some folks, but not everyone, so I don't begrudge using the GTX line.

Disclosure: I work on Google Cloud.

Re:Benchmarking TensorFlow on Cloud CPUs: Cheaper Deep Learn... by user5994461 on Sunday July 09, 2017 @06:12AM (#14729097)
Unless I am mistaking, Tesla have ECC memory and consumers cards don't.

Should do some marketing on the disastrous effects it can have on the training.

Re:Benchmarking TensorFlow on Cloud CPUs: Cheaper Deep Learn... by nl on Sunday July 09, 2017 @09:27AM (#14729628)
Or.. just call it random dropout and market it as a feature.
Re:Benchmarking TensorFlow on Cloud CPUs: Cheaper Deep Learn... by boulos on Sunday July 09, 2017 @10:45PM (#14733046)
(Also, I can no longer edit, but a colleague pointed out that I should have read more carefully. A GTX 1080 is a Pascal part, which compared to the poor old Kepler in K80s, it'll really shine. Volta all the more so in the next year).