News for hackers. Stuff that matters.
Re:Jax and Equinox: What are they and why should I bother? by Lerc on Thursday September 12, 2024 @05:26PM (#41525765)
For me the questions to answer for whether or not I should bother.

Will it try and bind me to other technologies?

Does it work out of the box on ${GPU}?

Is it well supported?

Will it continue to be supported?

Re:Jax and Equinox: What are they and why should I bother? by crazygringo on Thursday September 12, 2024 @07:59PM (#41526910)
Playing with JAX on Google Colab (Nvidia T4), everything works great.

Sadly, I cannot get JAX to work with the built-in GPU on my M1 MacBook Air. In theory it's supposed to work:

https://developer.apple.com/metal/jax/

But it crashes Python when I try to run a compiled function. And that's only after discovering I need an older specific version of jax-metal, because newer versions apparently don't work with M1 anymore (only M2/M3) -- they don't even report the GPU as existing. And even if you get it running, it's missing support for complex numbers.

I'm not clear whether it's Google or Apple who is building/maintaining support for Apple M chips though.

JAX works perfectly in CPU mode though on my MBA, so at least I can use it for development and debugging.

Re:Jax and Equinox: What are they and why should I bother? by spearman on Friday September 13, 2024 @12:26AM (#41528019)
Pretty sure it's Apple building it, and they're using JAX in-house so I imagine it will get better over time. Though they do love to drop support for old things so maybe M1 will never work again...
Re:Jax and Equinox: What are they and why should I bother? by mccoyb on Friday September 13, 2024 @06:28AM (#41529825)
I think they’re likely using MLX in house now, no? (Probably not everyone, ofc - but seems likely that many will just use the native array framework designed explicitly for MX chips)
Re:Jax and Equinox: What are they and why should I bother? by spearman on Friday September 13, 2024 @04:25PM (#41534790)
From https://machinelearning.apple.com/research/introducing-apple...

> Our foundation models are trained on Apple's AXLearn framework, an open-source project we released in 2023. It builds on top of JAX

Re:Jax and Equinox: What are they and why should I bother? by mccoyb on Friday September 13, 2024 @08:19PM (#41536458)
Wow! thanks for the ref
Re:Jax and Equinox: What are they and why should I bother? by Archit3ch on Friday September 13, 2024 @10:16AM (#41531485)
Outside training, M1 also makes sense as a lower-bound deployment target ("we support Apple Silicon").
Re:Jax and Equinox: What are they and why should I bother? by spearman on Friday September 13, 2024 @12:30AM (#41528035)
Re support: JAX is open source and X, Apple, and Google all use it, so I can't imagine it being abandoned in the next 5 years at least.