But that's down to the way Claude Code has implemented it? If I code this myself I could engineer so that the subagents don't have overlapping context with the orchestrator.

Also, memory itself can be a tool the subagent calls to retrieve only the stuff it needs.