This is a very interesting idea. My criticism would be that our memories are such imperfect recollections of the real thing that its hard for me not to see them as a "copy" rather than a "pointer". Signal loss through the fabric of space?