I think it means you remember things by where they are relative to each other.

But yeah, the rotation effect makes it a bit confusing compared to normal space.