News for hackers. Stuff that matters.
Re:Behind the curtain: what it feels like to work in AI righ... by PeterisP on Thursday April 06, 2023 @10:34PM (#35477316)
There is a soft limit due to the computation required; the currently used model architectures are quadratic with respect to context size, so if you want ten times larger context size, that's going to need a hundred times more effort.

There are no comments on this comment yet.