Re:OpenAI's GPT-3 may be the biggest thing since Bitcoin
by Tarean on Sunday July 19, 2020 @01:42PM
(#23890947)
The transformer model in GPT-3 has a short context window and no recurrence. Without some significant architecture changes that is a fundamental limit on the problems GPT-3 can solve.
[ Parent
| on HN ]
Re:OpenAI's GPT-3 may be the biggest thing since Bitcoin
by lucidrains on Sunday July 19, 2020 @03:00PM
(#23891532)