Bumblebee: GPT2, Stable Diffusion, and More in Elixir

Re:Bumblebee: GPT2, Stable Diffusion, and More in Elixir by AlphaWeaver on Thursday December 08, 2022 @04:52PM (#33914091)

Congrats on the launch! Been eagerly sitting in the #elixir IRC channel all day :)

How easy would it be to support OpenAI's new Whisper transcription model in Bumblebee?

[ Parent | on HN ]

Re:Bumblebee: GPT2, Stable Diffusion, and More in Elixir by seanmor5 on Thursday December 08, 2022 @05:24PM (#33914574)

It should not be too hard! From what I saw Whisper is similar to Bart, and we have Bart. The missing piece is a library for audio processing to tensors.

[ Parent | on HN ]

Re:Bumblebee: GPT2, Stable Diffusion, and More in Elixir by tylrbrkr on Thursday December 08, 2022 @05:46PM (#33914842)

Would Nx Signal be that missing piece? https://github.com/polvalente/nx-signal

[ Parent | on HN ]

Re:Bumblebee: GPT2, Stable Diffusion, and More in Elixir by seanmor5 on Thursday December 08, 2022 @05:48PM (#33914861)

For some of it! I was thinking more something for loading different audio encodings to Nx tensors…so doing everything up until Nx

[ Parent | on HN ]

Re:Bumblebee: GPT2, Stable Diffusion, and More in Elixir by ricketycricket on Friday December 09, 2022 @01:14PM (#33924556)

I don't have the ML chops to make it happen, but whisper would be insanely useful to have in the tool chest.

[ Parent | on HN ]