Re:ExecuTorch: Enabling On-Device interference for embedded ...
by ai-joe on Tuesday October 17, 2023 @04:41PM
(#37921281)
ONNX Runtime has supported this for years - https://onnxruntime.ai/blogs/pytorch-on-the-edge
[ Parent
| on HN ]
Re:ExecuTorch: Enabling On-Device interference for embedded ...
by iseeyuan on Tuesday October 17, 2023 @04:49PM
(#37921391)
One difference here is that there is no conversion for ExecuTorch. In general conversions introduce inconsistency and are difficult to maintain, so ExecuTorch eliminates that step.