News for hackers. Stuff that matters.
Re:Autodidax: Jax Core from Scratch (In Python) by 6gvONxR4sf7o on Saturday February 11, 2023 @11:55AM (#34753987)
I love this. I wish every big library had something like this. It helped me contribute to JAX in the past, and is a great educational resource and source of inspiration for my own tools.

I’ve tried to find something similar for pytorch and numpy in the past and was let down.

Re:Autodidax: Jax Core from Scratch (In Python) by sva_ on Saturday February 11, 2023 @12:35PM (#34754365)
> I’ve tried to find something similar for pytorch and numpy in the past and was let down.

Well I got a treat for you then

https://minitorch.github.io/

Re:Autodidax: Jax Core from Scratch (In Python) by 6gvONxR4sf7o on Saturday February 11, 2023 @01:28PM (#34754844)
I don’t mean how I could implement a library with the torch API. I mean how torch is actually implemented. Do you know which this is?
Re:Autodidax: Jax Core from Scratch (In Python) by rck on Saturday February 11, 2023 @12:15PM (#34754174)
I think the closest thing for pytorch is the Karpathy video:

https://www.youtube.com/watch?v=VMj-3S1tku0

There's also an old book on the internals of numpy - not sure how out of date it is though.

Re:Autodidax: Jax Core from Scratch (In Python) by xavdid on Saturday February 11, 2023 @12:59PM (#34754602)
Same! I looked into how pytest worked and got bogged down in its plugin system (which is great, but very distracting when trying to read the code). I've always been curious how the assertion rewriting works.
Re:Autodidax: Jax Core from Scratch (In Python) by thelastbender12 on Saturday February 11, 2023 @01:24PM (#34754810)
But seriously, for open source projects actually looking for contributors (vis-a-vis companies with a developer product they just make open source), there is no better resource.

To understand a framework, you need a mental model of it. Good documentation is helpful, but it seldom walks through why specific design choices were necessary.