Re:PyTorch on Apple M1 MAX GPUs with SHARK – faster than Ten...
by magic_at_nodai on Tuesday February 22, 2022 @07:07PM
(#30435704)
Yeah the ANE and AMX on cpu are wrapped behind Accelerate Framework and CoreML. So you will have to use CoreML (which wasn't able to compile the latest TF BERT). ANE is also inference only. So if you want training you will have to use the GPU with Apple's Tensorflow-Metal.
//part of nod.ai / SHARK team.