News for hackers. Stuff that matters.
Re:Tinygrad and rusticl and aco: why not? by xiphias2 on Saturday July 15, 2023 @12:43PM (#36738609)
I did small changes, took part of the Twitch sessions and thinking and understanding it. I contributed the main ideas for Kernel search, and was happy to get George out of a mini depression with some quick fun wins. He almost gave it up, but now the progress every day is crazy.

The way to implement anything new and cool is to read it all first.

I love the way convolutions and matmuls are both expressed using ShapeTracker and simple mul operation for example. No other framework has that elegance.

Until you understand that part, it's not worth trying to change it.

There are no comments on this comment yet.