Another reason extremely long context lengths may not be fully necessary is that engines can store information in a database, update it based on further interactions, etc