News for hackers. Stuff that matters.
Re:Building LLMs from the Ground Up: A 3-Hour Coding Workshop by jph00 on Sunday September 01, 2024 @01:36PM (#41418685)
fast.ai also does autograd from scratch - and goes further than Karpathy since it even does matrix multiplication from scratch.

But it doesn’t start there. It uses top-down pedagogy, instead of bottom up.

Re:Building LLMs from the Ground Up: A 3-Hour Coding Workshop by BaculumMeumEst on Sunday September 01, 2024 @01:53PM (#41418817)
Oh that’s interesting to know! I guess I gel better with bottom up. As soon as I start seeing API functions I don’t understand I immediately want to know how they work!