News for hackers. Stuff that matters.
Re:Philosophers on GPT-3 by segfaultbuserr on Thursday July 30, 2020 @09:44PM (#24004830)
The meta-question: Does the commentary in GPT-3's output apply to the output itself?
Re:Philosophers on GPT-3 by visarga on Friday July 31, 2020 @01:52AM (#24006089)
Yes, transformers allow attention to flow to all previous tokens, even while the phrase is being generated.