The entire point is that it shouldn't become inaccessible, because that is WHY time symmetry appears to break. Because it means that if you flipped the direction of time, something with a causal effect appears seemingly randomly out of nowhere.