ai-joe
Re:ExecuTorch: Enabling On-Device interference for embedded devices
on Tuesday October 17, 2023 @04:41PM (#37921281)
ONNX Runtime has supported this for years - https://onnxruntime.ai/blogs/pytorch-on-the-edge