The quantum eraser does work with particles with mass. Here is a paper that performs the experiment with electrons (specifically a transmon qubit): https://advances.sciencemag.org/content/3/5/e1603159
It works with even larger particles as well such as molecular ions or buckyballs.
From the perspective of the photon the time stands still, it arrives instantly at the destination.
You can see this in that the quantum eraser experiment only works with photons and not particles with mass like electrons.