If it helps, think of the Universe as always having been infinite in size, even in the microseconds after the Big Bang. What was happening, is that the space between everything inside of the Universe, was inflating extremely rapidly.