News for hackers. Stuff that matters.

A comment on How do I get started with Jax on TPU VMs. Parent comment

Re:How do I get started with Jax on TPU VMs by kaycebasques on Saturday March 30, 2024 @01:09PM (#39876608)
Are there any resources going into detail about why the big players prefer JAX? I've heard this before but have never seen explanations of why/how this happened.
[ Parent | on HN ]
Re:How do I get started with Jax on TPU VMs by _ntka on Saturday March 30, 2024 @01:45PM (#39876939)
It's all about cost and performance. If you can train a foundation model 2x faster with JAX on the same hardware, you are effectively slashing your training costs by 2x, which is significant for a multi-million dollar training run.
[ Parent | on HN ]
Re:How do I get started with Jax on TPU VMs by ein0p on Saturday March 30, 2024 @03:49PM (#39878000)
“Faster” might have been true pre-Hopper, but there’s no such guarantee now.
[ Parent | on HN ]