News for hackers. Stuff that matters.
Re:Accelerating TensorFlow Performance on Mac by olliej on Wednesday November 18, 2020 @03:17PM (#25141882)
Wait, so are they using the GPUs or the "neural engine"? because the gpu approach should also work on any other machine right?
Re:Accelerating TensorFlow Performance on Mac by roughly on Wednesday November 18, 2020 @03:50PM (#25142280)
The Apple ML Research group announcement has more details: https://machinelearning.apple.com/updates/ml-compute-trainin...

Key line:

  Until now, TensorFlow has only utilized the CPU for training on Mac. The new tensorflow_macos fork of TensorFlow 2.4 leverages ML Compute to enable machine learning libraries to take full advantage of not only the CPU, but also the GPU in both M1- and Intel-powered Macs for dramatically faster training performance.
So, looks like it's faster on both Intel & M1, but the M1 MBP has a much faster GPU than the Intel MBP
Re:Accelerating TensorFlow Performance on Mac by microtherion on Wednesday November 18, 2020 @04:21PM (#25142609)
But note that the ANE and the GPU are different facilities.
Re:Accelerating TensorFlow Performance on Mac by roughly on Wednesday November 18, 2020 @07:38PM (#25144769)
Correct - I’d guess this is Not using the neural engine.

I don’t know enough about that hardware to hazard a guess about how easy it would be to get that part of the chip involved.

Re:Accelerating TensorFlow Performance on Mac by TYPE_FASTER on Wednesday November 18, 2020 @03:48PM (#25142252)
Looks like Tensor Flow now supports ML Compute, which in turn uses the appropriate hardware.

In the case of the Mac Pro, I'm guessing ML Compute is using the GPU.

In the case of the Intel MacBook Pro 13", which as far as I can tell from Apple's site can't be purchased with a discrete GPU, that will be either the Intel Iris GPU, or the CPU.

In the case of the M1 MacBook Pro 13", I'm assuming ML Compute prioritizes the Neural Engine over the GPU (and CPU), but don't know if there are use cases where the GPU would be preferable.

Re:Accelerating TensorFlow Performance on Mac by pram on Wednesday November 18, 2020 @04:07PM (#25142453)
It looks like the class only has cpu and gpu types so, as has been the case, figuring out when the 'neural engine' is invoked is remains opaque:

https://developer.apple.com/documentation/mlcompute/mlcdevic...

Re:Accelerating TensorFlow Performance on Mac by spookyboomba on Wednesday November 18, 2020 @03:41PM (#25142172)
As the charts compare Intel based Macs vs the new M1 chip, they would be comparing CPU performance.
Re:Accelerating TensorFlow Performance on Mac by loukrazy on Wednesday November 18, 2020 @03:51PM (#25142289)
The charts are comparing “accelerated” performance versus what appears to be a cpu only baseline. It is not clear which M1 hardware beyond the CPU is used