News for hackers. Stuff that matters.
Re:Which GPU(s) to Get for Deep Learning by chronic940 on Monday May 22, 2017 @04:25PM (#14396637)
K80s and K40s have a K. That's two generations old. We are currently on P and about to be V. If you think K80s are good, you are far far behind the times in machine learning. A single 1080Ti even in a 4U server outperforms 2 K80s.
Re:Which GPU(s) to Get for Deep Learning by arnon on Monday May 22, 2017 @05:46PM (#14397193)
If you're running a rackmount server, you need the Tesla series.

We found that the GeForces tend to burn out when under heavy load, whereas we've not had a single Tesla series ever burn out.

Re:Which GPU(s) to Get for Deep Learning by maksimum on Monday May 22, 2017 @08:36PM (#14397948)
Ooh ooh tell us more. Which GeForces and which server chassis? Adequate power supply?
Re:Which GPU(s) to Get for Deep Learning by sgt101 on Tuesday May 23, 2017 @02:54AM (#14399332)
Yes - more details please.

We've been using Titan-X and 1080 Maxwells in some Broadberry 4u chassis for the last year/18mths and we've had no burnouts so far.

I'm buying replacement pascals, and I can't justify teslas when I can get 8 geforces for the price of 1...

Re:Which GPU(s) to Get for Deep Learning by arnon on Tuesday May 23, 2017 @03:34AM (#14399518)
Dell R720 / R730s, dual GPU (typically with K40m or K80) in there with 1100W dual redundant PSUs and the GPU enablement kit. We also set our fans to constant 70% min, to keep the airflow good.

On some servers we introduced the GTX 1080, either along-side a K40/K80 or two per chassis (see http://arnon.dk/how-does-the-nvidia-gtx-1080-stack-up-agains...).

They actually work 15% faster on average compared to the Tesla K series (Remember it's a 5 year old card), but they just stop working after a few months, or return inconsistent results for some operations.

Now, we're not doing graphics with them. We have a GPU database called SQream DB - and we depend on the results to be correct. In the end, they didn't make a lot of sense for us to deploy in a production environment, so back to the Tesla series we went.

Re:Which GPU(s) to Get for Deep Learning by sgt101 on Monday May 22, 2017 @04:45PM (#14396799)
Ok - p100's? The thing is that a K80 costs.... £4k what is it that people are paying for?
Re:Which GPU(s) to Get for Deep Learning by dragandj on Monday May 22, 2017 @05:02PM (#14396923)
ECC memory (not that everyone really need that)...
Re:Which GPU(s) to Get for Deep Learning by sgt101 on Tuesday May 23, 2017 @02:52AM (#14399322)
In a tensorflow job I find it hard to imagine that a memory error would make a jot of difference... wouldn't the error simply be removed by the network training? If the error was in the execution then I imagine that the epoch would fail and it would then just be a matter of restarting.