This is really cool. One mechanic could be that the older ghosts start vanishing / growing weaker / corrupting the physics as you add more. Exploiting this could be part of the puzzle in some way.