News for hackers. Stuff that matters.
Re:Show HN: Microcrad – Micrograd Reimplemented in C by Saloc on Sunday June 21, 2026 @05:20AM (#48617122)
Nice project! Im curious, did you had a look on performance vs. a baseline tensor framework? With Copapy I was initially surprised that in many non ANN applications for vector and matrix operations such a scalar approach can be (due to sparcity) much faster than a tensor based implementation like numpy.
Re:Show HN: Microcrad – Micrograd Reimplemented in C by oraziorillo on Sunday June 21, 2026 @09:48AM (#48618976)
I haven’t really looked into performance comparisons with tensor-based frameworks. This was mainly a learning project, so my goal wasn’t to make it fast.

My guess is that a scalar engine might have an advantage on tiny optimization problems (among others) with only a handful of variables, where the overhead of tensor frameworks dominates the runtime.