Re:Deploying Transformers on the Apple Neural Engine
by amelius on Wednesday June 08, 2022 @10:48AM
(#31668171)
> Any abstraction layer will add overhead and probably present a lowest common denominator interface. The audience willing to accept those costs is small.
Eh ... lots of people use Tensorflow or Torch.
Re:Deploying Transformers on the Apple Neural Engine
by hprotagonist on Wednesday June 08, 2022 @11:00AM
(#31668336)
which together are about 5 separate abstraction layers that don’t agree with each other. (tf 1,2, keras, torch, torch functional, …)
so we add onnx and trt on top! that’ll help, right?
Any abstraction layer will add overhead and probably present a lowest common denominator interface. The audience willing to accept those costs is small.