Re:OpenXLA Is Available Now
by sanxiyn on Thursday March 09, 2023 @07:27AM
(#35080525)
Sadly, I don't think so. Android already has NNAPI, but this post doesn't mention NNAPI at all. This seems focused on running on servers, instead of running on user devices.
[ Parent
| on HN ]
That would be a shame. Where does Apple fit in then, are they running custom ML frameworks in their cloud?
The post itself doesn't get into too many details about edge deployment, but we're building the core technology to scale down to embedded systems without compromising on feature support. In fact, resource constrained devices really benefit from ahead-of-time compilation to improve binary size and finely control memory usage. We (IREE) published a paper focusing on such embedded device uses: https://arxiv.org/abs/2205.14479.