Physical systems have finite information storage capacity. Our infinities are descriptions of recursive processes (either iteration or subdivision). The quantization we've observed in the universe is a strike against infinities of subdivision, and it's literally impossible to observe a macro-infinity, so from a scientific perspective physical infinity is unsupported and seems unlikely.

Space might appear "infinite" if you set up a word problem where you fire two photons off in opposite directions and track the distance between them over time, but without an observer the only place information exists is in those photons, and space is meaningless. Infinities of time are likewise artificial constructs of measurement, there is only the current moment.