News for hackers. Stuff that matters.
Re:The Illustrated Transformer by jwitthuhn on Monday December 22, 2025 @05:21PM (#46359861)
If you have 20 hours to spare I highly recommend this youtube playlist from Andrej Karpathy https://www.youtube.com/watch?v=VMj-3S1tku0&list=PLAqhIrjkxb...

It starts with the fundamentals of how backpropagation works then advances to building a few simple models and ends with building a GPT-2 clone. It won't taech you everything about AI models but it gives you a solid foundation for branching out.

There are no comments on this comment yet.