It's perfectly sensible given a common frame of reference, which we have thanks to the CMB. Frames of reference aren't local. We have clocks and can measure time on them just fine, and 'now' is just a time on a clock.