News for hackers. Stuff that matters.
Re:We Aren't Close to Creating a Rapidly Self-Improving AI by jimsimmons on Saturday April 29, 2023 @12:00PM (#35754145)
GP is wrong.

Attention is all you need paper just proposed an AR model that didn’t have to be trained step by step. The scaling happened later in BERT and GPT and OpenAI’s scaling work

There are no comments on this comment yet.