I also have the same experience with memory. Often I'll revisit an area and have a very strong recollection of a particular part of a story/book and be momentarily confused. Until I realise that yes, the first time I listened to a particular story was on a particular road or by a park somewhere. Naturally this effect is reduced if it's a place I go to all the time, presumably because I've overwritten that memory dozens of times.