News for hackers. Stuff that matters.
Re:DeepLearning10: The 8x Nvidia GTX 1080 Ti GPU Monster by mippie_moe on Wednesday June 07, 2017 @04:56PM (#14509790)
The author wasn't joking about the noise levels. This machine sounds like an F1 race car.

If you don't require a rack mounted server, a cluster of workstations like NVIDIA's DIGITS DevBox is far more cost efficient (and less noisy). I run a compute intensive business (Dreamscopeapp.com) and we opted to build a cluster of desktop-like machines instead of using a rack mounted solution. Another benefit is you don't run into the power issues mentioned in the post.

My start-up actually sells the machine described in this post: https://lambdal.com/nvidia-gpu-server

And a machine inspired by the NVIDIA DIGITS DevBox: https://lambdal.com/nvidia-gpu-workstation-devbox

Re:DeepLearning10: The 8x Nvidia GTX 1080 Ti GPU Monster by intoverflow2 on Thursday June 08, 2017 @05:53AM (#14513034)
>The author wasn't joking about the noise levels. This machine sounds like an F1 race car.

One of the reasons 3D artists who are using GPU rendering generally go for liquid cooling (that and it makes the cards single slot)

http://rawandrendered.com/Octane-Render-Hepta-GPU-Build

Re:DeepLearning10: The 8x Nvidia GTX 1080 Ti GPU Monster by dgacmu on Wednesday June 07, 2017 @10:18PM (#14511402)
So - tried your quote form. The options are 4x 1080ti, 4x titan Xp, or 8x P100 --- but no 8x 1080ti? Or is the quote form wrong?

16.5K seems pretty reasonable for 8x 1080ti with a bit of profit for building it, but unreasonable for only 4x 1080ti. My home-built 4x1080ti box (without quite enough PCIe bandwidth, admittedly) is under $6k. I'm assuming/hoping there's an error there. :)

Screenshot of the order form: https://www.dropbox.com/s/2nm00w1rd6du6ey/Screenshot%202017-...

Oh, also - if I want a quote on both the big server and the little workstation I have to enter my contact info twice? Not particularly customer-friendly.

Re:DeepLearning10: The 8x Nvidia GTX 1080 Ti GPU Monster by p1esk on Thursday June 08, 2017 @12:24PM (#14515232)
For quad GPU config you should look at dev box type option. It's $8,750 for machine with 4 1080Ti, 64GB of RAM, and 1TB SATA SSD. Quite a steep margin if you ask me, considering a 128GB RAM machine that you build yourself would cost you at most $5,700 (taxes included) if you get everything from Amazon, and probably under $5k if you're willing to shop around a little.
Re:DeepLearning10: The 8x Nvidia GTX 1080 Ti GPU Monster by highd on Wednesday June 07, 2017 @05:05PM (#14509872)
I feel like you should be able to do better than $15K for $7.2K worth of graphics cards.
Re:DeepLearning10: The 8x Nvidia GTX 1080 Ti GPU Monster by mippie_moe on Wednesday June 07, 2017 @06:20PM (#14510305)
You can save a ton of money by building your own machine.

The server we sell is packaged with software we wrote that makes administering significantly easier. We also provide technical support and even a limited amount of free machine learning consulting. The customers who purchase this server want a headache free solution and aren't as price sensitive as a lone researcher.

Re:DeepLearning10: The 8x Nvidia GTX 1080 Ti GPU Monster by jjn2009 on Wednesday June 07, 2017 @06:59PM (#14510528)
heres a part list to build a pc with 1080ti's: https://pcpartpicker.com/user/Jjn2009/saved/#view=McvMpg

notice the custom part box accounts for two more GPUs, I'm not sure why the site doesn't let you add 4 to the GPU section.

This setup ranges from $5250 with 4 GPU to $3240 with 1 GPU. You might want to bump up the PSU for 4 GPU its currently 1500 watts, which may or may not be enough at max load. The article shows a max of ~2800 watts with 8 GPUs

Re:DeepLearning10: The 8x Nvidia GTX 1080 Ti GPU Monster by dgacmu on Wednesday June 07, 2017 @10:30PM (#14511440)
nice - btw, the Rosewill Tokamak 1500 from newegg is a way to save a few bucks on that build, though it's out of stock (they just had it on sale). It's also 80+ titanium.
Re:DeepLearning10: The 8x Nvidia GTX 1080 Ti GPU Monster by p1esk on Thursday June 08, 2017 @12:10PM (#14515154)
Actually, that's a pretty bad config:

Mobo does not support 4x16 PCIe lanes (that's why they didn't want you to add 4 GPU cards).

Mobo is limited to 64GB RAM.

$520 for two 256GB 840 Pro SSDs? Seriously?

Here's a better mobo: https://www.amazon.com/Motherboards-X99-E-WS-USB-3-1/dp/B00X...

Also, you can literally double the RAM for the same money: http://www.ebay.com/itm/128gb-DDR4-8-Crucial-16gb-DDR4-2400m... (keep in mind that speed of RAM is irrelevant for DL tasks).

Re:DeepLearning10: The 8x Nvidia GTX 1080 Ti GPU Monster by sunsu on Wednesday June 07, 2017 @11:52PM (#14511802)
I purchased a couple of the machines from these guys for my team and had a great experience. Highly recommended if you have better ways to spend your time than building them yourself.
Re:DeepLearning10: The 8x Nvidia GTX 1080 Ti GPU Monster by science404 on Wednesday June 07, 2017 @05:51PM (#14510152)
Can confirm that. Have this box (with 8 K80s) and we measured 90dB next to the box..
Re:DeepLearning10: The 8x Nvidia GTX 1080 Ti GPU Monster by kough on Wednesday June 07, 2017 @06:59PM (#14510525)
I ask this out of deep curiosity and by no means with any intent to offend: how does (will?) dreamscopeapp.com make any money? (I don't have an Android device or I'd install it – I'm asking because it's entirely unapparent from your web presence.)
Re:DeepLearning10: The 8x Nvidia GTX 1080 Ti GPU Monster by mippie_moe on Wednesday June 07, 2017 @07:19PM (#14510646)
No offense taken!

Dreamscope doesn't actually make money :) It's a little under break even. It brings in revenue through a $9.99/mo premium subscription, which gives customers higher resolution images.

Re:DeepLearning10: The 8x Nvidia GTX 1080 Ti GPU Monster by kough on Thursday June 08, 2017 @04:26AM (#14512750)
Ah – that's fairly reasonable! Thanks for the answer :)
Re:DeepLearning10: The 8x Nvidia GTX 1080 Ti GPU Monster by EvgeniyZh on Wednesday June 07, 2017 @06:07PM (#14510238)
Doesn't the fact you get 8 PCIe lines per GPU affects performance?
Re:DeepLearning10: The 8x Nvidia GTX 1080 Ti GPU Monster by mippie_moe on Wednesday June 07, 2017 @06:26PM (#14510346)
With this setup, you get one GPU that runs with 16 lanes (and as you mentioned, three that run with 8).

Bottleneck depends on the workload. If you're training a small/fast network, data bandwidth is a real problem.

That being said, for most cases, a workstation build that provides every GPU with 16 lanes is far less cost effective.

Re:DeepLearning10: The 8x Nvidia GTX 1080 Ti GPU Monster by braindead_in on Thursday June 08, 2017 @02:32AM (#14512333)
Nice! Would you be supporting Volta GPUs when it is launched?
Re:DeepLearning10: The 8x Nvidia GTX 1080 Ti GPU Monster by mippie_moe on Thursday June 08, 2017 @08:05PM (#14518180)
Yes!
Re:DeepLearning10: The 8x Nvidia GTX 1080 Ti GPU Monster by nojvek on Thursday June 08, 2017 @12:42PM (#14515343)
How much do the devboxes go out for? Prices not mentioned.