Network Outage in EU affecting AMS1 and AMS2

Posted by ibarrajo on Monday May 19, 2014 @04:36PM
from the digitaloceanstatus.com dept.

http://www.digitaloceanstatus.com/

From Digital Ocean:

At this time we're experience a network outage in our AMS1 and AMS2 datacenters. With secondary impact affecting customers in Europe. As a result, you may experience latency, connectivity issues, or slow pings.

Preliminary investigation indicates that Telias Transatlantic cable are down. We are working to resolve the issue and apologize for any interruption this causes for you. Mon May 19 20:29:32 2014

( 13 comments | 16 points | on HN )

Re:Network Outage in EU affecting AMS1 and AMS2 by carlio on Monday May 19, 2014 @04:57PM (#7769698)

A bit of tracerouting and some twitter searching[0] suggests that the issue likes with Telia.net. There are some unconfirmed suggestions that a cable was severed[1], which I'm not sure I believe yet but certainly any packet going via telia.net is having a bad time.

Edit: Even CloudFlare are reporting the cable cut[2] so... gosh.

[0] https://twitter.com/search?q=telia&src=typd

[1] https://twitter.com/CurseNetworkSys/status/46849347754249420...

[2] https://twitter.com/CloudFlare/status/468493714134822912

[ Parent | on HN ]

Re:Network Outage in EU affecting AMS1 and AMS2 by lucaspiller on Monday May 19, 2014 @05:19PM (#7769809)

Related discussion:

https://news.ycombinator.com/item?id=7769587

From the UK everything seems to be working normal now, including access to my instance in AMS1.

[ Parent | on HN ]

Re:Network Outage in EU affecting AMS1 and AMS2 by nodesocket on Monday May 19, 2014 @05:03PM (#7769727)

Akamai has a nice visualization map. Look at all that red in Europe.

http://www.akamai.com/html/technology/dataviz1.html

[ Parent | on HN ]

Re:Network Outage in EU affecting AMS1 and AMS2 by raiyu on Monday May 19, 2014 @06:04PM (#7770018)

It looks like from our end that there was a large trans-atlantic issue which affected a lot of the connectivity between the US and EU and other providers were affected.

In our case we had to route around Telia which seemed to be the link that was having the most issues and we're getting more info from them to see what happened and when it will be safe to add them back into the mix.

Thanks, Moisey Cofounder DigitalOcean

[ Parent | on HN ]

Re:Network Outage in EU affecting AMS1 and AMS2 by nodesocket on Monday May 19, 2014 @04:39PM (#7769614)

As a side effect, anybody else getting intermittent false alarms from Pingdom?

[ Parent | on HN ]

Re:Network Outage in EU affecting AMS1 and AMS2 by bobfunk on Monday May 19, 2014 @05:16PM (#7769796)

yeah, got a bunch - guess they're not strictly speaking false, it's just not something most of us can do anything about...

[ Parent | on HN ]

Re:Network Outage in EU affecting AMS1 and AMS2 by peterwaller on Monday May 19, 2014 @04:49PM (#7769657)

You're not the only one.

[ Parent | on HN ]

Re:Network Outage in EU affecting AMS1 and AMS2 by thehodge on Monday May 19, 2014 @04:55PM (#7769689)

I had this issue on the new beeper system, I switched back to the old system and have had no issues since.

[ Parent | on HN ]

Re:Network Outage in EU affecting AMS1 and AMS2 by ccozan on Monday May 19, 2014 @05:18PM (#7769804)

In Germany we felt it for about 15mins, now the routing is adjusted and we are back to normal.

This is a nice reminder that the Internet was designed to resist to such disturbances.

[ Parent | on HN ]

Re:Network Outage in EU affecting AMS1 and AMS2 by abritishguy on Monday May 19, 2014 @05:01PM (#7769713)

Transatlantic cable has been cut, lots of sites affected.

[ Parent | on HN ]

Re:Network Outage in EU affecting AMS1 and AMS2 by diorray on Monday May 19, 2014 @04:54PM (#7769683)

It's not Digital Ocean's fault. It seems like CloudFlare, Twitter and Facebook's EU servers are down too..

[ Parent | on HN ]

Re:Network Outage in EU affecting AMS1 and AMS2 by sampo on Monday May 19, 2014 @05:03PM (#7769726)

I am in Europe, and I can reach Facebook's EU servers just all right :-).

[ Parent | on HN ]

Re:Network Outage in EU affecting AMS1 and AMS2 by ultrasaurus on Monday May 19, 2014 @05:23PM (#7769828)

At PagerDuty we saw our alerting volume double between 19:50 and 20:00 UTC (about 90 minutes ago).

[ Parent | on HN ]