Re:Why is so much memory needed for deep neural networks?
by Roritharr on Thursday March 23, 2017 @12:58AM
(#13937487)
129000$ for the DGX-1, for anyone interested.
Saves you debugging your way to a workable 8*1080ti, when you look at it from this angle. Not sure if being able to swap out the cards is what makes building them yourself worth it in addition to the cost saving.
Re:Why is so much memory needed for deep neural networks?
by modeless on Thursday March 23, 2017 @02:42AM
(#13937807)
P100 has double rate FP16 which makes it twice as fast, so make that 16x 1080Ti. Also those won't fit into one machine, so now you're building a cluster, and what are you going to use for the interconnect? You won't get linear scaling, so make that more like 24x 1080Tis plus extra development effort for scaling on a cluster, if your problem even scales that way. Now account for the power usage...
Re:Why is so much memory needed for deep neural networks?
by llukas on Thursday March 23, 2017 @03:58AM
(#13938029)
What interconnect do you have between those 8*1080ti? If your problem doesn't require communication then it may make sense.
If you require non-trivial communication no PCIe setup would beat NVLink communication bandwidth on DGX-1.
Re:Why is so much memory needed for deep neural networks?
by jacquesm on Thursday March 23, 2017 @07:15AM
(#13938788)
> 129000$ for the DGX-1, for anyone interested.
If you are allowed to buy one. Nvidia doesn't have nearly enough chips to meet demand, the bulk of their production has been earmarked for quite a while ahead, what little is left over and makes it into the DGX-1 is sold to very few hand picked customers.
Feel free to invest your time and money into building and debugging issues on your own system. Companies which pay big $$$ to their data scientists have different incentives than regular users - you do not want to waste time of your expensive staff on chasing hardware/software issues.