That's not necessary (and is even less likely): the "you" at any given instant would be a Boltzmann brain with the memory of existing at previous instants.