News for hackers. Stuff that matters.
Re:How GPT3 Works – Visualizations and Animations by stingraycharles on Tuesday July 28, 2020 @04:41AM (#23973684)
I few this comment is overly negative. Just to provide a counter-datapoint, I have seen quite a bit of GPT3 on HN lately but could not understand the research papers at all. It’s too abstract, and I often fail to see what they really mean.

This article and the animations definitely helped me a lot in understanding this. I learned quite a few things, so thanks a lot to the author!

Re:How GPT3 Works – Visualizations and Animations by wodenokoto on Tuesday July 28, 2020 @05:22AM (#23973913)
It explains a sequence to sequence model which, granted, is a class of models that GPT-3 falls under.

But these animations/diagrams are so high level that they could be used for Explaining all sorts of NLP models from the past 5 years.