Re:The Transformer Family
by yonz on Sunday January 29, 2023 @04:30PM
(#34572973)
Great compilation, would be great to see Vision Transformer (ViT) included.
Andrej Karpathy's GPT video is a must have companion for this https://youtu.be/kCc8FmEb1nY I was going nuts trying to grok Key, Query,Position and Value until
Andrej broke it down for me.
Andrej Karpathy's GPT video is a must have companion for this https://youtu.be/kCc8FmEb1nY I was going nuts trying to grok Key, Query,Position and Value until Andrej broke it down for me.