Re:Philosophers on GPT-3
by visarga on Friday July 31, 2020 @01:52AM
(#24006089)
Yes, transformers allow attention to flow to all previous tokens, even while the phrase is being generated.
[ Parent
| on HN ]
There are no comments on this comment yet.