Re:Why is so much memory needed for deep neural networks?
by modeless on Thursday March 23, 2017 @02:42AM
(#13937807)
P100 has double rate FP16 which makes it twice as fast, so make that 16x 1080Ti. Also those won't fit into one machine, so now you're building a cluster, and what are you going to use for the interconnect? You won't get linear scaling, so make that more like 24x 1080Tis plus extra development effort for scaling on a cluster, if your problem even scales that way. Now account for the power usage...
Re:Why is so much memory needed for deep neural networks?
by llukas on Thursday March 23, 2017 @03:58AM
(#13938029)
What interconnect do you have between those 8*1080ti? If your problem doesn't require communication then it may make sense.
If you require non-trivial communication no PCIe setup would beat NVLink communication bandwidth on DGX-1.
Re:Why is so much memory needed for deep neural networks?
by jacquesm on Thursday March 23, 2017 @07:15AM
(#13938788)
> 129000$ for the DGX-1, for anyone interested.
If you are allowed to buy one. Nvidia doesn't have nearly enough chips to meet demand, the bulk of their production has been earmarked for quite a while ahead, what little is left over and makes it into the DGX-1 is sold to very few hand picked customers.
Saves you debugging your way to a workable 8*1080ti, when you look at it from this angle. Not sure if being able to swap out the cards is what makes building them yourself worth it in addition to the cost saving.