Similarly, if I go to some new place with a friend or a group where I'm not the one leading, I would never remember the road. Even after multiple trips.

If I go by myself even once, I will always remember how to get there.

This phenomen is quite common and pretty straightforward if you think about it.