News for hackers. Stuff that matters.
Re:SmolGPT: A minimal PyTorch implementation for training a ... by c0wb0yc0d3r on Thursday January 30, 2025 @12:31AM (#42875185)
I don’t have a solid ML foundation, and it’s been a decade or more since I’ve worked with linear algebra.

For now I think that might be too deep for what I’m after. I’m at the beach looking out at the vast ocean that is machine learning and LLMs.

Re:SmolGPT: A minimal PyTorch implementation for training a ... by barrenko on Thursday January 30, 2025 @03:30AM (#42876034)
You're probably having the right hunch, it takes a crapload of time, especially if you want to implement and not just "get an intuition".