Taking a slight sidetrack to relativity, consider just how absurd our universe is. To maintain the consistency of the speed of light from all reference frames, time (and 'real' distance) are instead the variables, and there is every reason to believe this is correct. If you didn't know this to be the actual case, it'd feel absurd to even consider it.

Trying to intuitively and logically reason about something with no answer in sight, all while assuming the truths of our era, may ultimately be pointless.

Our universe, logical though it may be, plays by its own rules, and many things will be simply irreconcilable until those rules are further elaborated on.

As an aside the big bang also does not really answer the prerequisite question of where the initial inorganic matter/energy came from. The idea there being some sort of a quantum fluctuation, which then begs the question of its origin. I suppose it's just turtles all the way down.