Different worlds interact by interference. To interfere they must be in some sense "adjacent" so that they can both evolve into the exact same world - but with opposite phase. If you have a huge object like a human it's very hard to get every single atom to line up with those of the other world.