News for hackers. Stuff that matters.

A comment on Apple: Transformer architecture optimized for Apple Silicon.

Re:Apple: Transformer architecture optimized for Apple Silicon by callen43 on Friday March 24, 2023 @05:41AM (#35286929)
Is there also something available to make use of the ANE during _training_? E.g fine-tuning BERT on an M1 Mac in a couple of hours?

(This here only applies to inference, right?)

[ Parent | on HN ]
Re:Apple: Transformer architecture optimized for Apple Silicon by machinekob on Friday March 24, 2023 @06:52AM (#35287381)
Its FP16/Int8 inference only (cause you can only access it via apple frameworks that dosent support training). Also its only used if your data is small enough (4mb cache) it wont be useful for big transformers/ big images processing in a while.
[ Parent | on HN ]