I think it’s like the universe being a balloon (infinite or not) and inflating it. The space between any two points on the balloon increases over time. And at the Big Bang the space was basically 0.