News for hackers. Stuff that matters.
Re:Microgpt by WithinReason on Sunday March 01, 2026 @04:21AM (#47205095)
I made an explicit reverse pass (no autodiff), it was 8x faster in Python
Re:Microgpt by love2read on Sunday March 01, 2026 @06:05PM (#47211719)
Can you share a link?
Re:Microgpt by WithinReason on Monday March 02, 2026 @11:54AM (#47220542)
https://www.ideone.com/VAz4Nn

Doesn't run inside IDEone due to the external download link, but you can copy&paste the code over

Re:Microgpt by hu3 on Sunday March 01, 2026 @11:56PM (#47214042)
I made an explicit double-reverse pass (no code!), it was 80x faster in my head!
Re:Microgpt by spopejoy on Monday March 02, 2026 @09:20AM (#47218280)
Re:Microgpt by WithinReason on Monday March 02, 2026 @04:26PM (#47224335)
code here, it's just not interesting to look at:

https://news.ycombinator.com/item?id=47220542

Re:Microgpt by bear3r on Monday March 02, 2026 @12:13AM (#47214104)
tradeoff worth naming: you avoid the autodiff graph overhead (hence the speedup), but any architecture change means rewriting every gradient by hand. fine for a pedagogical project, but that's exactly why autodiff exists.