News for hackers. Stuff that matters.
Re:PyTorch is dead. Long live Jax by srush on Friday August 16, 2024 @05:06PM (#41270420)
PyTorch is a generationally important project. I've never seen a tool that is so inline with how researchers learn and internalize a subject. Teaching Machine Learning before and after its adoption has been a completely different experience. Never can be said enough how cool it is that Meta fosters and supports it.

Viva PyTorch! (Jax rocks too)

Re:PyTorch is dead. Long live Jax by PostOnce on Saturday August 17, 2024 @05:56AM (#41273175)
Torch was originally a Lua project, hence why pytorch is called pytorch and not just torch.

In another timeline AI would have made Lua popular.

The best part is it trampled TensorFlow which I personally find obtuse.

Re:PyTorch is dead. Long live Jax by n7g on Saturday August 17, 2024 @06:14AM (#41273276)
> In another timeline AI would have made Lua popular.

I wonder if it'd have been hated more than Python is - especially with the 1-based indexing...

Re:PyTorch is dead. Long live Jax by CuriouslyC on Saturday August 17, 2024 @07:36AM (#41273731)
Python isn't hated AFAICT, though people will profess to hating building large projects in it (myself included), but many of those people also love it for shorter programs and scripts.
Re:PyTorch is dead. Long live Jax by dartos on Sunday August 18, 2024 @09:52AM (#41282391)
Everything is hated.

Python has always gotten hate for being super super slow and having an ugly syntax (subjective ofc, but I happen to agree)

Re:PyTorch is dead. Long live Jax by goatlover on Sunday August 18, 2024 @11:35AM (#41282987)
Scientific computing tends to be 1-based. Thus R, Julia, Fortran, Matlab.
Re:PyTorch is dead. Long live Jax by deepsquirrelnet on Saturday August 17, 2024 @10:26AM (#41274837)
This is exactly why I gravitated to it so quickly. The first time I looked at pytorch code it was immediately obvious what the abstractions meant and how to use them to write a model architecture.

Jax looks like something completely different to me. Maybe I’m dumb and probably not the target audience, but it occurs to me that very few people are. When I read about using Jax, I find recommendations for a handful of other libraries that make it more useable. Which of those I choose to learn is not entirely obvious because they all seem to create a very fragmented ecosystem with code that isn’t portable.

I’m still not sure why I’d spend my time learning Jax, especially when it seems like most of the complaints from the author don’t really separate out training and inference, which don’t necessarily need to occur from the same framework.

Re:PyTorch is dead. Long live Jax by 6gvONxR4sf7o on Saturday August 17, 2024 @11:36AM (#41275272)
Honestly, when I turn to JAX, I generally do it without a framework. It’s like asking for a framework to wrap numpy to me. Just JAX plus optax is sufficient for me in the cases I turn to it.
Re:PyTorch is dead. Long live Jax by pjmlp on Tuesday August 20, 2024 @03:16AM (#41297619)
Additionally, nowadays it also has Java and C++ bindings to the same native libraries, so others can enjoy performance without having to rewrite their research afterwards.