News for hackers. Stuff that matters.
Re:Building an LLM from Scratch: Automatic Differentiation by wredue on Thursday February 15, 2024 @09:21PM (#39392337)
Is this YouTube series also “from scratch (but not really)”

Edit - it is. Not to talk down on the series. I’m sure it’s good, but it is actually “LLM with PyTorch”.

Edit - I looked again and I was actually not correct. He does ultimately use frameworks, but gives some early talk about how those function under the hood.

Re:Building an LLM from Scratch: Automatic Differentiation by deadfast on Friday February 16, 2024 @07:57AM (#39396336)
I appreciate you coming back and giving more details, it encourages me to look into it now. Maybe my expectations on the internet are just low, but I thought it was a virtuous act worth the effort, I wish more people would continue with skepticism but be willing to follow through and let their opinions change given solid evidence.