News for hackers. Stuff that matters.
Re:OpenAI’s CEO Says the Age of Giant AI Models Is Already Over by nwlieb on Monday April 17, 2023 @07:29PM (#35608021)
The runtime is quadratic for a given context size, although it seems like there is some progress on this front https://gwern.net/note/attention

There are no comments on this comment yet.