There's Matrex, which is based on CBLAS and has some integration with IElixir, Jupyter's kernel for Elixir.

Also someone seems to be doing interesting work to integrate with GPU at https://github.com/sasagawa888/deeppipe2

Of course that's not to say that Elixir is ready to replace Python tomorrow. I just wanted to mention interesting projects in this area.