News for hackers. Stuff that matters.
Re:MacOS finally gains external GPU support by libdjml on Friday March 30, 2018 @12:46PM (#16717673)
Can anyone comment on whether this will be useful for training neural networks?
Re:MacOS finally gains external GPU support by michaelgreen on Friday March 30, 2018 @02:49PM (#16718766)
So I've been using an eGPU for about 3 months now and it is amazing. This isn't officially supported so you end up having to do a lot of work arounds to get things like tensorflow/pytorch working.

It doesn't let you hot plug your eGPU into your computer (you have to restart for it to work) but for officially supported eGPUs you're now able to do that.

I've trained various models using a Titan XP and it's so awesome to be able to maintain the portability of your laptop and still get all of that power. A large benefit is also not having to move training data around between servers and other machines if you have it on an external drive or just on your laptop.

After you get everything up and running there isn't that much maintenance or anything you have to do regularly to keep it working. The speedup is incredible and it was definitely worth it for me personally, however it's not a walk in the park to get it set up initially.

Re:MacOS finally gains external GPU support by dmix on Friday March 30, 2018 @03:52PM (#16719278)
Neat. Have you tried it with any games?
Re:MacOS finally gains external GPU support by michaelgreen on Friday March 30, 2018 @04:57PM (#16719740)
I've tried it with an external monitor which works great but I haven't tried it with any games. From looking at the eGPU forums it seems like people aren't running into that many problems with it.
Re:MacOS finally gains external GPU support by bitL on Friday March 30, 2018 @02:44PM (#16718725)
IMO it's more cost effective and stable just to buy a Ryzen 2400G system (the same cost as a good eGPU case), put in Linux and use it for training at a full speed. TB3 has 4x lower throughput than PCIe, so if you need to transfer a lot of data (any meaningful non-toy model these days), it's better to stick with internal GPU. Not mentioning Linux is 1st class/preferred platform for many frameworks like TensorFlow etc.
Re:MacOS finally gains external GPU support by walshemj on Saturday March 31, 2018 @06:53AM (#16722755)
I say for thease sort of application why bother with MAC at all just go with Ryzen or wait for Ryzen2 out this month or go the full Threadripper or Eypc / Rome
Re:MacOS finally gains external GPU support by minimaxir on Friday March 30, 2018 @01:00PM (#16717796)
No. Officially, this doesn't support NVIDIA cards yet, which are a requirement for any modern DL framework.

There are beta NVIDIA drivers (http://www.nvidia.com/download/driverResults.aspx/131833/en-...) for macOS, but your mileage will vary.

Re:MacOS finally gains external GPU support by samcat116 on Friday March 30, 2018 @01:21PM (#16717971)
These aren’t beta drivers. They’ve been released for quite some time and are updated with (almost) every macOS release. However I’d say they’re pretty barebones as Nvidia doesn’t seem to care too much about the Mac at this point.
Re:MacOS finally gains external GPU support by minimaxir on Friday March 30, 2018 @01:23PM (#16717993)
The notes say "Includes BETA support for iMac and MacBook Pro systems with NVIDIA graphics." (specifically, Pascal drivers)

The reason for that is Apple hasn't shipped a iMac/MacBook Pro with an NVIDIA card in years, which is especially annoying for DL work.

Re:MacOS finally gains external GPU support by michaelgreen on Friday March 30, 2018 @02:51PM (#16718787)
In practice they work just fine, it's just very annoying to initially set them up and you have to do some patching to get the latest version of tensorflow working with it. I use one every day and I haven't run into any problems while running models with both pytorch and tensorflow.
Re:MacOS finally gains external GPU support by mkagenius on Friday March 30, 2018 @01:38PM (#16718139)
There is a project working for this: https://github.com/plaidml/plaidml
Re:MacOS finally gains external GPU support by kogir on Friday March 30, 2018 @12:52PM (#16717725)
Yes, it will allow you to use a much more powerful graphics card, as long as your training isn't limited by bus bandwidth.
Re:MacOS finally gains external GPU support by malcolmgreaves on Friday March 30, 2018 @02:54PM (#16718804)
Only if the software you have supports it. For example, Tensorflow on OS X doesn't use GPUs since version 1.2