News for hackers. Stuff that matters.

A comment on The Little Book of Generative AI Foundations: An Intuitive Mathematical Primer.

Re:The Little Book of Generative AI Foundations: An Intuitiv... by amplifydev on Tuesday November 03, 2026 @05:05PM (#50358913)
Interesting!

Is there any one who have recommended books on the attention architecture specifically? I have been interested in that for a long time but never gotten around to actually studying it.

[ Parent | on HN ]
Re:The Little Book of Generative AI Foundations: An Intuitiv... by achandra03 on Tuesday November 03, 2026 @05:08PM (#50358934)
Not a book, but 3blue1brown's video on attention is pretty great: https://www.youtube.com/watch?v=eMlx5fFNoYc
[ Parent | on HN ]
Re:The Little Book of Generative AI Foundations: An Intuitiv... by horseloverthin on Tuesday November 03, 2026 @05:29PM (#50359159)
formal algorithms for transformers provides perhaps the most succinct introduction to attention I can imagine https://arxiv.org/pdf/2207.09238
[ Parent | on HN ]