News for hackers. Stuff that matters.

A comment on Llm.c – LLM training in simple, pure C/CUDA. Parent comment

Re:Llm.c – LLM training in simple, pure C/CUDA by karpathy on Monday April 08, 2024 @07:56PM (#39974942)
I wrote this, which might be a bit helpful: https://github.com/karpathy/llm.c/blob/master/doc/layernorm/...

But if you don't have the background, I'd recommend my YouTube videos, see the Zero To Hero playlist: https://www.youtube.com/watch?v=VMj-3S1tku0&list=PLAqhIrjkxb...

[ Parent | on HN ]
Re:Llm.c – LLM training in simple, pure C/CUDA by blackeyeblitzar on Monday April 08, 2024 @08:05PM (#39975009)
Thank you so much for responding. I will definitely check these out and also pass it on to others who might be interested.
[ Parent | on HN ]
Re:Llm.c – LLM training in simple, pure C/CUDA by MAMAMassakali on Tuesday April 09, 2024 @04:22AM (#39977220)
Thank you so much for the Zero To Hero playlist!
[ Parent | on HN ]