It's true, I fully accept your point, but the wording made me ask myself where "everything" is located. 20 years ago I might have assumed it was unambiguously located somewhere in the U.S., but I think as time passes and the Internet grows and changes shape, Europe and other countries have begun to play a more important part.
This is an example where a traffic-based network diagram could be used to locate the Internet's "center of mass", so to speak, a region or location that could be described as the middle of everything.
In the Nordic region in particular the huge dissimilarity between Scandinavian languages and Finnish is driving it imo. If the cultural bloc were only Norway/Denmark/Sweden, I think it would settle on a kind of "Scandinavian" (their written forms are mutually intelligible). But that would exclude Finns from the Nordic family, so the working language has to be English, whether it's in formal institutions like the Nordic Council, or informal ones like http://www.reddit.com/r/Nordiccountries. I think this is only going to accelerate, and Americans will gradually become a smaller proportion of English-language online posters than they used to be, as the younger generation of Europeans who are comfortable in English become more present in anglophone contexts. But it'll be a while before there's a real critical mass.
Hence, Australia relies on content from the English speaking world which is dominated on the Internet by the U.S., this translates to trans-pacific cabling to the U.S. West Cost which is pretty pricey.
Australia has the massive disadvantages of: 1. being miles away from everything, 2. having small population with high Internet-demands and 3. having very, very little "local" content.
This means a large majority of Australia's Internet needs must be serviced by extremely expensive not-at-scale trans-Pacific services.
Places like Germany, Japan, Korea don't have these same issues. They have tons of "local" content and when they need to hop to the USA it's using infrastructure that is massively at scale (i.e. serving a continent like Europe or Asia, as opposed to Australia).
Not to say the Australian circumstances aren't an example of a massive regulatory cluster, but it's not quite as simple as it sounds.