It comes from the inherent sloppy irrelevance of the notion of speed compared with the actual behavior of reality. If you cared about a different variable instead, it would not be so limited.