Re:The Transformer Family
by nmfisher on Sunday January 29, 2023 @10:47PM
(#34575562)
It took me a long time to wrap my head around the whole "key/query/value" explanation (and to be honest I regularly forget which vector is which). I find the "weighted sum of vectors" explanation much simpler/more intuitive; this blog post is IMO the best on the subject:
https://peterbloem.nl/blog/transformers