Re:Verizon 4G LTE is down, nationwide outage confirmed
by Nrsolis on Wednesday December 07, 2011 @09:33PM
(#3327284)
The thing you have to understand about "wireless" systems like CDMA/GSM/HSPDA/LTE is that there is little diversity in the vendors of these types of systems and there are a bunch of relatively closed protocols that govern how things like the base stations authenticate subs and do provisioning of stations. It's not like IP; it's more like Novell IPX.
So even though LTE is ostensibly an IP-based system, there are a host of dependencies on single vendor closed management systems and protocols that could be the cause of any outage. A nationwide outage points to the failure of one of these systems to properly handle letting subscriber stations onto the network, not something simple like getting packets from here to there.
Think failure of the RADIUS/DNS like systems, not the routing infrastructure.
Re:Verizon 4G LTE is down, nationwide outage confirmed
by Maven911 on Thursday December 08, 2011 @12:52AM
(#3327893)
Your premise is more accurate, you just need to replace IPX with 3GPP standard protocols (vendors dont make their own protocols - everything is standardized), and instead of radius/dns (which are used in telcos nonetheless), its more likley HLRs,CSCFs, MMEs, or PDN gateways that can bring an entire network to its knees, or a poorly implemented mobile backhaul solution
Here are some other wild guesses that may have little or no resemblance to what Verizon is experiencing, but kind of show what can bring down an Internet-like network:
* Some sort of configuration fat-finger that got rolled out everywhere without proper testing. You'd like to think that's impossible on this scale, but after having an insider's look at the operations of a couple major US cable companies, I put nothing past telecoms.
* Verizon probably runs some form of routing protocol internally. If a core router has gone insane, you could, conceivably, get route flapping and bring down pretty much everything, but that's not supposed to happen on carrier-grade equipment (cough see previous paragraph).
* In a closely related scenario, large portions of the public Internet have been brought to their knees at least once by a nasty BGP bug in a major vendor's routers that got triggered when somebody broadcast just the right set of options in their announcement. Picture a guy in upstate New York trying to route around a bad line card, and suddenly the US goes dark because half the routers crash when they got the BGP table update.
You can probably spot a common theme here -- a "decentralized" but homogenous network is still vulnerable to the triggering of problems shared by all points.