News for hackers. Stuff that matters.
Re:MinGPT: Minimal PyTorch re-implementation of GPT by a-dub on Tuesday September 06, 2022 @10:41AM (#32737716)
> Even though I have only been working on machine learning for around six years, it's crazy to see how the landscape has changed so fast so recently, including diffusion models and transformers.

it's pretty wild considering how hidden markov models were considered state of the art not all that long ago.

Re:MinGPT: Minimal PyTorch re-implementation of GPT by visarga on Tuesday September 06, 2022 @11:26AM (#32738422)
Some people demean GPT-3 saying it's just a Markov model.