News for hackers. Stuff that matters.

A comment on Implementing a ChatGPT-like LLM from scratch, step by step. Parent comment

Re:Implementing a ChatGPT-like LLM from scratch, step by step by tayo42 on Saturday January 27, 2024 @01:36PM (#39158364)
He has like 4 or 5 videos that can be watched before that one where all of that is covered. He goes over stuff like writing back prop from scratch and implementing layers without torch.
[ Parent | on HN ]
Re:Implementing a ChatGPT-like LLM from scratch, step by step by _giorgio_ on Saturday January 27, 2024 @01:55PM (#39158593)
I know... That material isn't for beginners.
[ Parent | on HN ]
Re:Implementing a ChatGPT-like LLM from scratch, step by step by mikeiavelli on Saturday January 27, 2024 @10:14PM (#39162199)
...but then, what material did you expect as a beginner?
[ Parent | on HN ]
Re:Implementing a ChatGPT-like LLM from scratch, step by step by _giorgio_ on Monday January 29, 2024 @04:33AM (#39174436)
How can Karpathy videos defined for beginners when you have to know: programming, python, pytorch, matrix multiplication, derivatives...
[ Parent | on HN ]