Re:Why Google Went Offline Today and a Bit about How the Int...
by archangel_one on Tuesday November 06, 2012 @07:29AM
(#4748072)
I'm not a network engineer, but it seems like the kind of thing that might be very hard to detect when you're already inside or near to the google.com domain. Or maybe CloudFlare just got there first.
I don't think it's necessary to call BS on Cloudflare without any kind of evidence at all.
Re:Why Google Went Offline Today and a Bit about How the Int...
by amalcon on Tuesday November 06, 2012 @08:18AM
(#4748215)
This is basically correct. BGP is weird. The addresses for one of Google's many datacenters were routed incorrectly for packets coming from some subset of IP space. Unless Google is running active ping tests to that subset of IP space, the way they would normally detect it is for someone to call and complain.
In this case, the author decided to take a shortcut and call the owner of the "problem peer" directly.
Re:Why Google Went Offline Today and a Bit about How the Int...
by veidr on Tuesday November 06, 2012 @08:46AM
(#4748317)
Although only a vanishingly small percentage of Google users can call and complain. Blog or tweet or post to HN and hope Matt Cutts sees it and notifies the right team, maybe.
Re:Why Google Went Offline Today and a Bit about How the Int...
by Matt_Cutts on Tuesday November 06, 2012 @10:54AM
(#4748918)
A team of Googlers could have been working on this in parallel to Tom. I'm guessing that a sudden drop of queries like that would cause people at Google to start digging into what happened. I don't know either way, because network ops and BGP is pretty far from my area (search quality).
Re:Why Google Went Offline Today and a Bit about How the Int...
by mh- on Tuesday November 06, 2012 @09:05AM
(#4748402)
>Blog or tweet or post to HN and hope Matt Cutts sees it and notifies the right team, maybe.
It seems that's more or less the quasi-official support channel even for paid services from Google.
Re:Why Google Went Offline Today and a Bit about How the Int...
by jauer on Tuesday November 06, 2012 @11:01AM
(#4748952)
A common way to notice things like this is to subscribe to a service like Renesys or Cyclops (http://cyclops.cs.ucla.edu/) that will alert you if it sees your subnets being announced by a different AS.
Re:Why Google Went Offline Today and a Bit about How the Int...
by emilw on Tuesday November 06, 2012 @08:05AM
(#4748169)
Stop excusing yourself for not being something, either read more and then comment or trust your gut feeling. (not meant to sound harsh)
Re:Why Google Went Offline Today and a Bit about How the Int...
by JohnLBevan on Tuesday November 06, 2012 @08:29AM
(#4748258)
I think it's good to qualify your opinion with your level of expertise. There's no rule that says HN should only be for discussion by experts (hopefully there never will be), and if you don't know something for sure it's best to say so that others don't take your word as gospel. That said, I'm no expert ;).
Re:Why Google Went Offline Today and a Bit about How the Int...
by michaelt on Tuesday November 06, 2012 @08:23AM
(#4748232)
It sounds weird that Google did not triggered a recovery procedure on its own.
It's possible they didn't have the personal contact details for the engineer capable of fixing the problem.We all know how hard it can be to contact a competent person at a big corporation when you have a problem [1]. Would Google find it easier than every other human being?
Re:Why Google Went Offline Today and a Bit about How the Int...
by precisioncoder on Tuesday November 06, 2012 @08:14AM
(#4748194)
The key quote seems to be "Looking at peering maps, I'd estimate the outage impacted around 3–5% of the Internet's population." so if it didn't affect google directly it would have to go through customer server -> network technicians which would probably take more than the 26 min that Google was down for those customers for. I'm sure they would have been right on it if it hadn't have been fixed so fast.
Re:Why Google Went Offline Today and a Bit about How the Int...
by notatoad on Tuesday November 06, 2012 @01:05PM
(#4749578)
It sounds like cloudflare simply got there first. Unless cloudflare is outright lying (highly unlikely) they saw a problem they could fix, and fixed it. What's the false advertising there?
Maybe I see bad things everywhere and you may call paranoïd, but could it be some sort of ("false") advertising on the side of cloudfare?