News for hackers. Stuff that matters.
Re:Apple M1 Ultra by TuringNYC on Tuesday March 08, 2022 @07:10PM (#30609230)
It shocks me how much payroll and cap-ex is spent on the M1 and how little is invested in getting TensorFlow/Pytorch to work on it. I could 10x my M1 purchases for our business if we could reliably run TensorFlow on it. Seems pretty shortsighted.

The GPU claims wouldnt even need to be on parity with NVIDIA, it would just need to offer a vertically integrated alternative to having to use EC2.

Re:Apple M1 Ultra by hedgehog on Tuesday March 08, 2022 @11:22PM (#30610907)
Having beaten my head on this for a while (and shipped the first reasonably complete ML framework that runs on Metal) Apple's opinion as expressed by their priorities is that it's just not important.
Re:Apple M1 Ultra by moflome on Tuesday March 08, 2022 @09:55PM (#30610410)
> reliably run TensorFlow

What reliability issues are you having with TensorFlow on M1 Macs?

Re:Apple M1 Ultra by TuringNYC on Tuesday March 08, 2022 @10:20PM (#30610530)
We've followed five different instructional and documentation pages to make it happen and none seem to consistently install. Throw in a corporate system where you need IT for root access to make changes and it is game over. So i've got an M1-max fully loaded and cant get TF running on it.

Now i've got a team of data scientists in a fully MBP shop and we're holding off upgrades to M1 until this all gets resolved.

On my personal M1, I managed to make it work, but its hard to know the layers of changes made and what exactly allowed it to work.

Re:Apple M1 Ultra by zamalek on Wednesday March 09, 2022 @07:58AM (#30613926)
You can get off this GPU circus and simply go with purpose-built AI solutions.

You can buy single tensor accelerators from Google: https://www.coral.ai/products/

You can buy a bunch of those integrated into a single PCI-E card. https://iot.asus.com/products/AI-accelerator/AI-Accelerator-...

Cheap too. Some of these work with Mac. More of them work for PC, because the hardware interface is outside of Apple's thin vertical slice/garden.

Re:Apple M1 Ultra by dwroberts on Saturday March 12, 2022 @05:37AM (#30650473)
These are devices for Tensorflow Lite which is more appropriate for IoT etc. not doing the intensive initial training of a complex model
Re:Apple M1 Ultra by fouc on Tuesday March 08, 2022 @11:12PM (#30610854)
Could be worth tracking what you did and make a new set of instructions, and trying to reproduce with a fresh install.
Re:Apple M1 Ultra by freemint on Wednesday March 09, 2022 @04:40AM (#30612636)
This is something Apple should pay people for.
Re:Apple M1 Ultra by hedgehog on Wednesday March 09, 2022 @11:26AM (#30616337)
Deep learning support for Mac is not going to happen at a level of quality you can rely on for research & dev work (like PyTorch + TensorFlow). The underlying problem is no big company cares about Mac platform and the work to maintain framework support for a specific piece of hardware is way beyond a hobby project. If you want your own on-prem hardware just buy Nvidia.