Re:Deploying Transformers on the Apple Neural Engine
by hedgehog on Thursday June 09, 2022 @03:14AM
(#31678391)
Ah, yeah, and that's an improvement over the historical state of their ML support. For inference the M1 is a nice platform (fastish and power efficient) but for research and training not fast or well supported enough to justify not using NVIDIA.
This is sadly not a unique situation for Apple's more specialized public frameworks — they're more like semi-private because nobody outside Apple can make them work.