News for hackers. Stuff that matters.
Re:Amazon EC2 currently down. Affecting Heroku, Reddit, Others by jmvoodoo on Monday October 22, 2012 @02:41PM (#4684698)
All of our EC2 hosts appear to be functioning fine, but they can't connect to their RDS instance which renders our app useless. If you scroll down the page you'll also see that RDS instances are having connectivity issues. Not sure if it's related but for RDS users the impact is far worse.

EDIT: We are also using multi-AZ RDS, so either Amazon's claims for multi-AZ are bs, or their claims that this is only impacting a single zone is bs.

Re:Amazon EC2 currently down. Affecting Heroku, Reddit, Others by spartango on Monday October 22, 2012 @06:30PM (#4685895)
Because RDS is built on EBS, any slight issue with EBS manifests itself as a nastier issue for RDS.

Interestingly, EBS will never return an I/O error up to the attached OS, which is likely a good decision as most OSes choke on disk errors. What this means, however, is that if something even get slow within EBS (let alone stuck), applications that are dependent on it will suffer. Most of these applications (such as databases) have connection/response timeouts for their clients, so while EBS might just be running slowly, a service like RDS will throw up connection errors instead of waiting even a bit more.

You can imagine the cascading errors that might result from such a situation (instance looks dead, start failover...etc)

Re:Amazon EC2 currently down. Affecting Heroku, Reddit, Others by Banduin on Monday October 22, 2012 @03:09PM (#4684885)
Our multi-zoned RDS instance was able to fail over to another zone with minimal downtime. It took about 2 minutes.
Re:Amazon EC2 currently down. Affecting Heroku, Reddit, Others by jmvoodoo on Monday October 22, 2012 @03:11PM (#4684896)
Lucky you? :)
Re:Amazon EC2 currently down. Affecting Heroku, Reddit, Others by modsearch on Monday October 22, 2012 @03:21PM (#4684963)
Our multi-AZ RDS instance did not failover correctly this time although it has in the past..
Re:Amazon EC2 currently down. Affecting Heroku, Reddit, Others by rynop on Monday October 22, 2012 @05:08PM (#4685550)
same here, no fail-over
Re:Amazon EC2 currently down. Affecting Heroku, Reddit, Others by jmccree on Monday October 22, 2012 @05:26PM (#4685628)
I had one multi-az failover correctly, however the security group was refusing connections to the web servers ec2 security group. I had to manually add in the private ips of the ec2 instances. It appears the API issue is affecting security group to ip lookups.
Re:Amazon EC2 currently down. Affecting Heroku, Reddit, Others by abailin on Monday October 22, 2012 @03:39PM (#4685068)
Same here, our servers are still up, but our RDS instance is down.