It's much simpler to simulate your universe if we only have to render what you're observing. I remember the days when we had to keep deleting telescopes and microscopes until we had enough processing power. Trains caused a lot of scenery to pop in before the new algorithm - we tried telling customers that the increased speed would kill them.