if the 4th dimension is time, the argument implies that the center is "a long time ago"
So from our point of view, we can never know if universe is actually infinitely distributed or not.
Then again, there's the matter of looking so far back that you can't see stars because it's so old and thus it's not that there is an edge but just that we can't observe one.
That would require stars to be outputting infinite energy in the form of light we can see. They are not, so we do get enough of their light to see them with the naked eye. The farther away they are, the less and less photons make it to our eyes. So, yes, you can look up in the night sky and see infinite galaxies, but your eyes are not sensitive enough to pick out the one or two photons every few seconds and tell you there is something there.
However, we have tools to do that for us: https://www.space.com/17755-farthest-universe-view-hubble-sp...
You and I both see that the surface area of a sand grain, distributed by explosion to a different surface area with the diameter of a beach ball, has a center in 3D space.
But from the perspective of a Flatlander on the expanding surface, looking at the distance to an adjacent microbe, the universe is growing, and there is no meaningful point on that 2D surface from which the expansion emanates, it's expanding everywhere.
There's no reason to believe our universe is not infinite. It's certainly effectively so.