Except mass/energy must be really drawing a line across time dimension, instead of being points in it, right? Otherwise anything traveling in space - and thus slightly sideways - would immediately desync with the universe around it and interact only with emptiness?