Escaped matter is somewhere else: it would do the Bang and expand into the less populated area. All you need is to assume that on a bigger scale the universe is uniform and all the Bangs are just the ripples in it.