News for hackers. Stuff that matters.
Re:The Transformer Family by nmfisher on Sunday January 29, 2023 @10:47PM (#34575562)
It took me a long time to wrap my head around the whole "key/query/value" explanation (and to be honest I regularly forget which vector is which). I find the "weighted sum of vectors" explanation much simpler/more intuitive; this blog post is IMO the best on the subject:

https://peterbloem.nl/blog/transformers

There are no comments on this comment yet.