iseeyuan
Re:ExecuTorch: Enabling On-Device interference for embedded devices
on Tuesday October 17, 2023 @07:01PM (#37922716)
Could you elaborate? What kind of web support you are looking for?
Re:ExecuTorch: Enabling On-Device interference for embedded devices
on Tuesday October 17, 2023 @06:56PM (#37922665)
Yes ExecuTorch is currently targeted at Edge devices. The runtime is written in C++ with 50KB binary size (without kernels) and should run in most of platforms. You are right that we have not integrated to Nvidia backend yet. Have you tried torch.compile() in PyTorch 2.0? It would do the Nvidia optimization for you without Torchscript. If you have specific binary size or edge specific request, feel free to file issues in https://github.com/pytorch/executorch/issues
Re:ExecuTorch: Enabling On-Device interference for embedded devices
on Tuesday October 17, 2023 @04:49PM (#37921391)
One difference here is that there is no conversion for ExecuTorch. In general conversions introduce inconsistency and are difficult to maintain, so ExecuTorch eliminates that step.