timshel1
Re:NanoGPT Slowrun: Language Modeling with Limited Data, Infinite Compute
on Wednesday March 04, 2026 @05:09PM (#47254652)
Modded-nanogpt is also much more data efficient than vanilla napogpt, even if some of the individual optimizations trade off higher throughput for worse data efficiency.