News for hackers. Stuff that matters.
Re:Rethinking Attention with Performers by silveraxe93 on Monday October 26, 2020 @10:27AM (#24896490)
This is quite a good explanation of transformers that gets shared a lot. [link](http://jalammar.github.io/illustrated-transformer/)

And here's a super simple implementation of GPT by Andrej Karpathy. [link](https://github.com/karpathy/minGPT/blob/master/mingpt/model....)

There are no comments on this comment yet.