Looking in the past doesn't change much, because the agent exists in the past too and is a cause of the present agent. But choice really happens in present, so distant past is a wrong place to look at, but if you look in the wrong place it's expected that you don't see anything.