News for hackers. Stuff that matters.

A comment on ExecuTorch: Enabling On-Device interference for embedded devices. Parent comment

Re:ExecuTorch: Enabling On-Device interference for embedded ... by modeless on Tuesday October 17, 2023 @07:29PM (#37922937)
Looks cool! Does the Vulkan backend work on PC? MLC-LLM proves it can work well and it would be cool to have a cross platform, minimal runtime, GPU-agnostic backend for PC too, not just mobile.
[ Parent | on HN ]
Re:ExecuTorch: Enabling On-Device interference for embedded ... by ssjia on Wednesday October 18, 2023 @11:27AM (#37930050)
The Vulkan backend does work on PC, as the only requirement is that Vulkan drivers are present. However, it was developed with mobile use-cases in mind and we haven't validated/optimized performance for PC.

As an aside, the Vulkan backend is tied to TorchScript at the moment, so it is not yet compatible with ExecuTorch. However, we are also planning to introduce a Vulkan delegate for ExecuTorch which will enable GPU delegation through ExecuTorch.

[ Parent | on HN ]