But we don't interact with much of it, it could be a cached copy of another sim.

Edit: Perhaps it's adaptive and only simulates what will be observed. And if some cost saving optimization artifacts are discovered within the sim, it can be fixed and reverted to a earlier state.

Edit2: Perhaps it only has to simulate from your perspective, but the more you critically observe and interact, the more expensive the simulation is.