News for hackers. Stuff that matters.
Re:OpenAI's GPT-3 may be the biggest thing since Bitcoin by Tarean on Sunday July 19, 2020 @01:42PM (#23890947)
The transformer model in GPT-3 has a short context window and no recurrence. Without some significant architecture changes that is a fundamental limit on the problems GPT-3 can solve.
Re:OpenAI's GPT-3 may be the biggest thing since Bitcoin by lucidrains on Sunday July 19, 2020 @03:00PM (#23891532)