News for hackers. Stuff that matters.

A comment on What Are Transformer Models and How Do They Work?. Parent comment

Re:What Are Transformer Models and How Do They Work? by metanonsense on Saturday April 15, 2023 @05:22AM (#35578988)
When I first tried to understand transformers, I superficially understood most material, but I always felt that I did not really get it on a "I am able to build it and I understand why I am doing it" level. I struggled to get my fingers on what exactly I did not understand. I read the original paper, blog posts, and watched more videos than I care to admit.

The one source of information that made it click to me were chapters 159 to 163 of Sebastian Raschka's phenomenal "Intro to deep learning and generative models" course on youtube. https://www.youtube.com/playlist?list=PLTKMiZHVd_2KJtIXOW0zF...

[ Parent | on HN ]
Re:What Are Transformer Models and How Do They Work? by arketyp on Saturday April 15, 2023 @06:25AM (#35579264)
I was in the exact same situation as you and I started watching those chapters by Raschka yesterday. I completely agree. Great resource.
[ Parent | on HN ]
Re:What Are Transformer Models and How Do They Work? by TyrianPurple on Saturday April 15, 2023 @08:38AM (#35580095)
Sebastian Raschka's course is really good. Gone through it like three times.
[ Parent | on HN ]