I think the idea is that by trying to actively look for changes, you shift your focus around, but don't actually remember that well what is placed where.

At least for me, my focus kept wondering around the room, never noticing that things that was previously there was replaced by something else.