Verizon and a BGP Optimizer Knocked Large Parts of the Internet Offline

Re:Verizon and a BGP Optimizer Knocked Large Parts of the In... by FussyZeus on Monday June 24, 2019 @11:10PM (#20270852)

Shame is one of the most effective tools in influencing human behavior, and from the sounds of this post and the other coverage on the incident, Verizon has earned far more ire than is directed at them in this blog post.

A lot of people seem to conflate speaking professionally with speaking like a doormat. Verizon, specifically the team in charge of this system, fucked up. There are varying levels to that of course; if you mess up the fonts in the end of month report to your super and he calls you a fucking idiot, he's probably an unbalanced person in need of mental help. If on the other hand you knock dead 15% of GLOBAL Internet traffic out of sheer laziness, I'd say you've earned more than a few 'go fuck yourself's.

[ Parent | on HN ]

Re:Verizon and a BGP Optimizer Knocked Large Parts of the In... by bogomipz on Monday June 24, 2019 @11:34PM (#20270963)

How about leaking session tokens and other sensitive data for millions of people during "Cloudbleed"? Were you advocating public shaming for Cloudflare then? Was that also "sheer laziness" and did they earn "more than a few" of your "go fuck yourself's"?

[ Parent | on HN ]

Re:Verizon and a BGP Optimizer Knocked Large Parts of the In... by Varriount on Tuesday June 25, 2019 @03:05AM (#20271783)

I fail to see how Cloudbleed and this event are the same. Cloudbleed was caused by a Cloudflare bug, true, but it wasn't caused by outright laziness (which this incident clearly was). Furthermore, unlike Verizon's distinct lack of communication regarding this incident, Cloudflare has generally been very good about reporting and communicating with the community.

[ Parent | on HN ]

Re:Verizon and a BGP Optimizer Knocked Large Parts of the In... by collinmanderson on Tuesday June 25, 2019 @08:58AM (#20273711)

> outright laziness (which this incident clearly was)

I don't think it was clearly laziness. It could have been a configuration mistake.

[ Parent | on HN ]

Re:Verizon and a BGP Optimizer Knocked Large Parts of the In... by bogomipz on Tuesday June 25, 2019 @09:31AM (#20273946)

Indeed and we saw that as a cause recently for a major Google outage. However that likely possibility of a bad config or edit doesn't fit the narrative Cloudflare is spinning here - that Verizon is simply dumb and lazy.

Clearly Verizon has inbound prefix filtering in place otherwise this would be a common occurrence for AS 701 and it is most certainly not. And it's quite surprising and sad to see how willing people are to just blindly parrot Cloudflare here and pile on. This of course was the desired outcome of the blog post.

[ Parent | on HN ]

Re:Verizon and a BGP Optimizer Knocked Large Parts of the In... by bogomipz on Tuesday June 25, 2019 @08:52AM (#20273675)

They are not same nor was I implying they were the same. The point being that oversight and genuine mistakes happen. However Cloudflare wants to characterize it as "sloppiness and laziness" when it's someone else. And even here you are "parroting" them here when neither you or they actually know the details do you? Clearly Verizon has prefix filtering in place in other places or this would be a regular occurrence for them and it is not. Cloudflare is pretty far down the list in importance during an outage that affected many companies - other Tier 1s, 2s etc. Just because Cloudflare didn't get a response does not mean they weren't communicating. I know two network engineers who were in contact with Verizon yesterday during the outage. But again you seem intent to just "pile on" after reading a one-sided and self-serving Cloudflare blog post.

[ Parent | on HN ]