News for hackers. Stuff that matters.
Re:Digital Ocean's network is down? by JohnTHaller on Saturday October 19, 2013 @09:47AM (#6576379)
One of the backbones is having issues. I think over in Level 3 land, again. I'm on Time Warner and unable to reach anything at Rackspace, Facebook, Hotmail, etc.
Re:Digital Ocean's network is down? by elliottcarlson on Saturday October 19, 2013 @10:09AM (#6576456)
Level3 has been having a lot of intermittent outages recently..
Re:Digital Ocean's network is down? by JohnTHaller on Saturday October 19, 2013 @10:41AM (#6576550)
It's an issue with Level 3. Details here: https://news.ycombinator.com/item?id=6576399
Re:Digital Ocean's network is down? by petercooper on Saturday October 19, 2013 @09:42AM (#6576363)
My DO based services, which are monitored by Pingdom, are all still showing as up. Internet Traffic Report is showing several routers as down in North America however: http://www.internettrafficreport.com/namerica.htm
Re:Digital Ocean's network is down? by mikecane on Saturday October 19, 2013 @09:43AM (#6576369)
Wow, if I'm counting correctly, eleven routers down. WTF happened? Is this a cyber attack?
Re:Digital Ocean's network is down? by elliottcarlson on Saturday October 19, 2013 @10:07AM (#6576447)
That's insignificant - there are always routers down, and the 24 hour traffic index is stable.
Re:Digital Ocean's network is down? by lgierth on Saturday October 19, 2013 @10:03AM (#6576435)
A couple of routers in Europe are down as well.
Re:Digital Ocean's network is down? by mikecane on Saturday October 19, 2013 @09:39AM (#6576355)
There seems to be an issue with the entire Net this morning.

Drudge Report unreachable.

Same for Twitter.

And WordPress dotcom's link to their Amazon S3 image storage is broken too.

Re:Digital Ocean's network is down? by xfax on Saturday October 19, 2013 @09:44AM (#6576372)
Damn. Looking forward to reading CloudFlare's post-mortem blog post on this. Seems to be widespread.
Re:Digital Ocean's network is down? by zarvox on Saturday October 19, 2013 @09:46AM (#6576377)
Update from https://status.digitalocean.com/ :

  Networking Issue in NY1 Facility
  
  At this time, we are currently investigating an issue in our NY1 facility.
  
  We are working to determine the exact cause/resolution of
  the issue and will provide details as soon as they
  become available.
Re:Digital Ocean's network is down? by njpatel on Saturday October 19, 2013 @09:43AM (#6576368)
Can ssh into some of the instances (and from there contact all the instances internally), but http/https ports definitely don't work. I think it's only NY1.

I realised, it would be great for cloudflare to optionally allow us to show a better 'down' page for non-static sites like dashboards etc. Right now it's showing the same page with a bar on top (and obviously login etc won't work), ideally it would show a static page where we could explain something is wrong, without login boxes etc.

Re:Digital Ocean's network is down? by zarvox on Saturday October 19, 2013 @09:38AM (#6576347)
As of this posting, https://www.digitalocean.com/login is returning CloudFlare's "Always Online" cache.

I just got woken up by two of our boxes being unreachable, but one of my other boxes is up, so maybe it's just affecting one of their datacenters?

Re:Digital Ocean's network is down? by mikecane on Saturday October 19, 2013 @10:00AM (#6576426)
I know WordPress dotcom uses Amazon S3 storage for images, so my blog isn't showing any due to this outage.

Amazon apparently also uses its own S3 for images because right now at Amazon none of the product images are showing.

Re:Digital Ocean's network is down? by ddorian43 on Saturday October 19, 2013 @09:34AM (#6576332)
It took a while(5seconds) but it opened for me.

Next time check: http://www.digitaloceanstatus.com/

Re:Digital Ocean's network is down? by entropyneur on Saturday October 19, 2013 @09:45AM (#6576373)
> Next time check: http://www.digitaloceanstatus.com/

Huh... Not the best source really. It took >30 minutes between I got an alert from the monitoring service and an update appearing on the status site.

Re:Digital Ocean's network is down? by cobrabyte on Saturday October 19, 2013 @09:56AM (#6576414)
Same here. Pingdom let me know one of my sites was down roughly 20 minutes before DO added their notification to the status page. Unfortunately, it appears all of my DO instances are in the NY1 facility. Bad on me.
Re:Digital Ocean's network is down? by tgeek on Saturday October 19, 2013 @10:36AM (#6576534)
everyone saying they can't hit certain sites(images on Wordpress/amazon/etc) is actually seeing the affect of their ISP's networks and the CDNs those sites use. Lotta Level3 issues right now. CDNs are often peered as close to the major ISP hubs as possible for speed reasons, but it can unfortunately result in these kind of chained outages. Since a lot of companies pump full site traffic through CDNs, it can appear as them being down.
Re:Digital Ocean's network is down? by tehwalrus on Saturday October 19, 2013 @09:55AM (#6576409)
all the things people are reporting down are working fine for me from the UK.

EDIT: except, I don't have a Digital Ocean NY instance I can try. Those might be down, but their website's fine.

Re:Digital Ocean's network is down? by ollydbg on Saturday October 19, 2013 @11:25AM (#6576689)
Looks like DO Europe nodes are up.
Re:Digital Ocean's network is down? by acesubido on Saturday October 19, 2013 @09:41AM (#6576361)
tumblr seems to be down on my side
Re:Digital Ocean's network is down? by mikecane on Saturday October 19, 2013 @09:52AM (#6576397)
I can't reach Tumblr either, or Toogles (YouTube search site).
Re:Digital Ocean's network is down? by easy_rider on Saturday October 19, 2013 @10:04AM (#6576438)
Contrary to Tumblr, Toogles works from Amsterdam, NL.
Re:Digital Ocean's network is down? by th0br0 on Saturday October 19, 2013 @09:48AM (#6576387)
can confirm that from germany
Re:Digital Ocean's network is down? by keithpeter on Saturday October 19, 2013 @09:55AM (#6576412)
...and UK.
Re:Digital Ocean's network is down? by petercooper on Saturday October 19, 2013 @10:01AM (#6576429)
Loading okay here from the UK. I'm getting a feeling from these threads here that there's some serious routing trouble going down rather than service outages as such.
Re:Digital Ocean's network is down? by keithpeter on Saturday October 19, 2013 @11:03AM (#6576620)
Was able to post to tumblr blog from Blackberry but not able to see page (on Orange UK broadband) until just now. Supports routing hypothesis I suppose.
Re:Digital Ocean's network is down? by easy_rider on Saturday October 19, 2013 @10:02AM (#6576432)
Confirmed, down in NL