As context sizes get larger (and remain accurate within the size) and speeds increase, especially inference, it will start solving these large complex code bases.

I think people lose sight of how much better it has gotten in just a few years.