News for hackers. Stuff that matters.
Re:Philosophers on GPT-3 by visarga on Friday July 31, 2020 @01:52AM (#24006089)
Yes, transformers allow attention to flow to all previous tokens, even while the phrase is being generated.

There are no comments on this comment yet.