Re:Behind the curtain: what it feels like to work in AI righ...
by theturtletalks on Thursday April 06, 2023 @09:13PM
(#35476834)
Is there a limit on how big the context size can be?
[ Parent
| on HN ]
Re:Behind the curtain: what it feels like to work in AI righ...
by kickette on Thursday April 06, 2023 @09:49PM
(#35477065)
There’s no theoretical limit
Re:Behind the curtain: what it feels like to work in AI righ...
by PeterisP on Thursday April 06, 2023 @10:34PM
(#35477316)
There is a soft limit due to the computation required; the currently used model architectures are quadratic with respect to context size, so if you want ten times larger context size, that's going to need a hundred times more effort.