Aren't you still discussing it in the form of a linear arrow of time? That initial decay is also the annihilation that forms a photon, when "reversed".