yes but is the memory for context able to grow linearly or is it an exponential growth that is required. If it's linear then it's going to get better really fast. If it's exponential it's going to be a bit more moors law like.

I have a feeling all of these things are limited by time/space/speed of light/heat/density limitations. Could be things can't get that much smarter than humans with in an OOM... tho they might get a lot more able to cooperate / delegate.