News for hackers. Stuff that matters.

A comment on Bumblebee: GPT2, Stable Diffusion, and More in Elixir. Parent comment

Re:Bumblebee: GPT2, Stable Diffusion, and More in Elixir by chem83 on Thursday December 08, 2022 @04:47PM (#33914014)
Congrats on the launch! Muito legal!

Alternatively to EXLA/Torchx, any thoughts on supporting an ML compiler frontend like Google IREE/MLIR by generating StableHLO or LinAlg? This could pave the way towards supporting multiple hardware targets (Vulkan-based, RVV-based, SME-based etc.) with minimal effort from the framework.

[ Parent | on HN ]
Re:Bumblebee: GPT2, Stable Diffusion, and More in Elixir by josevalim on Thursday December 08, 2022 @05:47PM (#33914850)
Yes, we have been eyeing IREE but no work has started yet. However, our compiler architecture was designed exactly to make this possible, so it will be definitely welcome if someone decides to trail ahead on this road!
[ Parent | on HN ]
Re:Bumblebee: GPT2, Stable Diffusion, and More in Elixir by seanmor5 on Thursday December 08, 2022 @05:26PM (#33914611)
There is a project in the ecosystem that builds on top of MLIR and can target any MLIR dialect, but it is not mature enough yet.

I think it would be great to see!

[ Parent | on HN ]