News for hackers. Stuff that matters.
Re:NanoGPT by visarga on Wednesday January 11, 2023 @03:42PM (#34344425)
This is a didactic implementation. If you read the HuggingFace repo it is much more abstracted on account they implement many models in the same codebase. It's not fast or big, just easier to read and tweak.
Re:NanoGPT by pms on Wednesday January 11, 2023 @10:01PM (#34348614)
If so, then why the second line of its documentation says that "it is a rewrite of minGPT that prioritizes teeth over education"?
Re:NanoGPT by ironrabbit on Thursday January 12, 2023 @12:19AM (#34349528)
minGPT prioritized being understandable above all else, and was not very fast. This repo includes several optimizations, but it still much more understandable than probably any other open source implementation.