But you can't escape the LLM context if there's nowhere to escape to :)

I.e. when the LLM is your only support option.