Re:Reproduce GPT-2 (124M) in llm.c in 90 minutes for $20
by kgwgk on Tuesday May 28, 2024 @05:07PM
(#40505621)
> Why write in CUDA and not just use PyTorch etc?
“LLM training in simple, pure C/CUDA. There is no need for 245MB of PyTorch or 107MB of cPython. […] A few more words on what I want this repo to be: First, I want llm.c to be a place for education.”
“LLM training in simple, pure C/CUDA. There is no need for 245MB of PyTorch or 107MB of cPython. […] A few more words on what I want this repo to be: First, I want llm.c to be a place for education.”