News for hackers. Stuff that matters.
Re:Behind the curtain: what it feels like to work in AI righ... by theturtletalks on Thursday April 06, 2023 @09:13PM (#35476834)
Is there a limit on how big the context size can be?
Re:Behind the curtain: what it feels like to work in AI righ... by kickette on Thursday April 06, 2023 @09:49PM (#35477065)
There’s no theoretical limit
Re:Behind the curtain: what it feels like to work in AI righ... by PeterisP on Thursday April 06, 2023 @10:34PM (#35477316)
There is a soft limit due to the computation required; the currently used model architectures are quadratic with respect to context size, so if you want ten times larger context size, that's going to need a hundred times more effort.