That doesn't necessarily mean signals going back in time. It could mean that the initial condition of the universe was set, such that nobody would do X. But that's still a way of the past (initial condition) being determined by the future, even if the future was just predicted via determinism. It makes physics teleological.

A common criticism of superdeterminism is that it eliminates falsifiability from science. E.g. to quote physicist Nicolas Gisin, "If we did not have free will, we could never decide to test a scientific theory. We could live in a world where objects tend to fly up in the air but be programmed to look only when they are in the process of falling." https://en.wikiquote.org/wiki/Superdeterminism

Fair enough I guess, but I'm not convinced it's a good answer to say "I think a theory with property X is the answer, and you can't criticize it because I have no actual theory with property X." I think it makes more sense to give little credence to superdeterminism until someone comes up with a plausible superdeterministic theory.