News for hackers. Stuff that matters.

A comment on What Are Transformer Models and How Do They Work?. Parent comment

Re:What Are Transformer Models and How Do They Work? by bomewish on Saturday April 15, 2023 @05:17AM (#35578962)
You seem to know a bunch about this. What’s your rec for best single explainer?
[ Parent | on HN ]
Re:What Are Transformer Models and How Do They Work? by isaacfung on Saturday April 15, 2023 @06:42AM (#35579364)
Not the guy you asked, but these are often recommended.

https://jalammar.github.io/illustrated-transformer/

https://nlp.seas.harvard.edu/2018/04/03/attention.html

[ Parent | on HN ]
Re:What Are Transformer Models and How Do They Work? by edge17 on Saturday April 15, 2023 @12:27PM (#35582075)
Before going and digging into these, could you also explain what the necessary background is for this stuff to be meaningful?

In spite of having done a decent amount with neural networks, I'm a bit lost at how we suddenly got to what we're seeing now. It would be really helpful to understand the progression of things because I stepped away from this stuff for maybe 2 years and we seem to have crossed an ocean in the intervening time.

[ Parent | on HN ]
Re:What Are Transformer Models and How Do They Work? by jaidhyani on Sunday April 16, 2023 @12:33PM (#35591519)
I am the guy asked and I endorse this guy's endorsements.
[ Parent | on HN ]