All "Infinities" are not the same, you are using the word in a colloquial sense (i.e. non-converging) while there actually are different definitions/interpretations.

See wikipedia : https://en.wikipedia.org/wiki/Infinity "Cosmology" section; the key point being The question of being infinite is logically separate from the question of having boundaries.