News for hackers. Stuff that matters.
Re:MinGPT: Minimal PyTorch re-implementation of GPT by mark_l_watson on Tuesday September 06, 2022 @02:01PM (#32740703)
Nice! I remember way back when studying Karpathy’s character RNN code, a great study resource. Looking forwards to understanding this example also!
Re:MinGPT: Minimal PyTorch re-implementation of GPT by karpathy on Tuesday September 06, 2022 @03:47PM (#32742307)
I am working on a video lecture series that will step through it and "spell it out". Without it even this code can be a bit opaque for someone who is new to the field and e.g. uncomfortable with n-dimensional array manipulations or the surrounding language modeling concepts.
Re:MinGPT: Minimal PyTorch re-implementation of GPT by fezfight on Tuesday September 06, 2022 @07:16PM (#32744393)
That's very generous of you. Thanks.

All we need now is a good, local copilot implementation. Has anyone done anything like that with minGPT that you know of? Something to inspire the masses like stable diffusion has with images.