> It's amazing to me that all these connections are still physicial (as opposed to some software-defined switching between providers). Something akin to software-defined networking.

What you're describing is called "local loop unbundling". Lots of other countries do it, it works great, and it would solve most if not all of the problems with the telco market in the US... so naturally these companies lobby hard to make sure it'll never happen.