Just curious, have you tried adding a feature to TinyGrad? Or are you arguing in the abstract because TinyGrad is small?

Because I personally have tried, and found the code to be so code-golf and spaghetti-like that I gave up, it just wasn’t worth my time (even for the $1000 bounty).

I did small changes, took part of the Twitch sessions and thinking and understanding it. I contributed the main ideas for Kernel search, and was happy to get George out of a mini depression with some quick fun wins. He almost gave it up, but now the progress every day is crazy.

The way to implement anything new and cool is to read it all first.

I love the way convolutions and matmuls are both expressed using ShapeTracker and simple mul operation for example. No other framework has that elegance.

Until you understand that part, it's not worth trying to change it.

Pytorch is pretty easy to add stuff to.