And who says that LLMs won't be able to adapt to new conditions?

Right now they are limited by the context, but that's probably a temporary limitation.