Re:Deploying Transformers on the Apple Neural Engine
by nmfisher on Wednesday June 08, 2022 @01:27PM
(#31670895)
That was the idea behind ONNX, which has been somewhat successful.
But if you’ve ever had to deploy these models, you’ll know it’s never as simple as promised. Different libraries use different ops, have weird export requirements or even noticeable performance issues.
But if you’ve ever had to deploy these models, you’ll know it’s never as simple as promised. Different libraries use different ops, have weird export requirements or even noticeable performance issues.