News for hackers. Stuff that matters.
Re:OpenXLA Is Available Now by sanxiyn on Thursday March 09, 2023 @07:27AM (#35080525)
Sadly, I don't think so. Android already has NNAPI, but this post doesn't mention NNAPI at all. This seems focused on running on servers, instead of running on user devices.
Re:OpenXLA Is Available Now by sorenjan on Thursday March 09, 2023 @08:13AM (#35080825)
That would be a shame. Where does Apple fit in then, are they running custom ML frameworks in their cloud?
Re:OpenXLA Is Available Now by scotttodd on Thursday March 09, 2023 @12:20PM (#35083743)
The post itself doesn't get into too many details about edge deployment, but we're building the core technology to scale down to embedded systems without compromising on feature support. In fact, resource constrained devices really benefit from ahead-of-time compilation to improve binary size and finely control memory usage. We (IREE) published a paper focusing on such embedded device uses: https://arxiv.org/abs/2205.14479.