If things were moving away from each other, there would have to be something that set them in motion away from each other. What made all far apart galaxies appear to move away from each other?

Expanding space doesn't necessarily imply edge of space. What if your universe isn't flat, what if it's a torus? It could hypothetically have a finite volume but no edge.

There's also no reason an infinite universe couldn't have local expansion everywhere.