News for hackers. Stuff that matters.
Re:Tell HN: Heroku is Down (update: recovering as of 10PM PST) by michaelfairley on Thursday June 14, 2012 @11:55PM (#4114850)
The AWS status page[1] is showing problems for EC2 East as of a few minutes ago. This <strike>might be</strike> is a more widespread issue.

EDIT: Various non-Heroku EC2-East-based sites (e.g. Quora) seem to be down as well, lending more evidence to this being an EC2/EBS outage.

1: http://status.aws.amazon.com/

Re:Tell HN: Heroku is Down (update: recovering as of 10PM PST) by dangrossman on Friday June 15, 2012 @12:13AM (#4114926)
Half the startup world is offline right now, yet the AWS status page is all greens with one "info" notice about EBS (which I doubt is the issue here). I'm glad to have moved off a fully AWS stack back to my own servers over a year ago. My uptime, bills, and stress level are all much improved.
Re:Tell HN: Heroku is Down (update: recovering as of 10PM PST) by res0nat0r on Friday June 15, 2012 @12:33AM (#4115007)
Sounds like half of the startup world hasn't spent the time or the money to design their service to be redundant on top of AWS.
Re:Tell HN: Heroku is Down (update: recovering as of 10PM PST) by zeeg on Friday June 15, 2012 @12:38AM (#4115024)
Fortunately for most, they dont have customers yet
Re:Tell HN: Heroku is Down (update: recovering as of 10PM PST) by reddit_clone on Friday June 15, 2012 @12:47AM (#4115048)
That made me laugh. Am I a bad person?
Re:Tell HN: Heroku is Down (update: recovering as of 10PM PST) by rhizome on Friday June 15, 2012 @12:47AM (#4115049)
The sales pitch is kind of that it's already redundant. You know, RAID and load balancers and all.
Re:Tell HN: Heroku is Down (update: recovering as of 10PM PST) by fusiongyro on Friday June 15, 2012 @12:45AM (#4115041)
That's hardly surprising. The groupthink on cloud services is that they magically make everything scalable, cheap and easy. Making redundant software is hard work.
Re:Tell HN: Heroku is Down (update: recovering as of 10PM PST) by michaelfairley on Friday June 15, 2012 @12:17AM (#4114943)
Definitely an EBS issue. Our (EBS backed, Heroku hosted) DB was returning queries more and more slowly leading up to the outage.
Re:Tell HN: Heroku is Down (update: recovering as of 10PM PST) by atlasom on Friday June 15, 2012 @12:33AM (#4115008)
They posted an update on amazon: We continue to investigate this issue. We can confirm that there is both impact to volumes and instances in a single AZ in US-EAST-1 Region. We are also experiencing increased error rates and latencies on the EC2 APIs in the US-EAST-1 Region.

Also Amazon Relational Database Service (N. Virginia) is unavailible.

Seems like its snowballing.

Re:Tell HN: Heroku is Down (update: recovering as of 10PM PST) by res0nat0r on Friday June 15, 2012 @01:14AM (#4115140)
RDS actually uses EBS so it is most likely the same underlying issue.
Re:Tell HN: Heroku is Down (update: recovering as of 10PM PST) by ajasmin on Friday June 15, 2012 @12:27AM (#4114983)
Out of curiosity do we know if http://status.aws.amazon.com/ is hosted on AWS?
Re:Tell HN: Heroku is Down (update: recovering as of 10PM PST) by sprout on Friday June 15, 2012 @12:32AM (#4115005)
It's a key design constraint of status.aws.amazon.com that it not depend on any AWS services. (Or so I've heard.)
Re:Tell HN: Heroku is Down (update: recovering as of 10PM PST) by ceejayoz on Friday June 15, 2012 @12:31AM (#4115002)
status.aws.amazon.com resolves to 207.171.185.167 for me.

That IP isn't in the EC2 IP ranges (https://forums.aws.amazon.com/ann.jspa?annID=1528), so at the very least it's not hosted on EC2.

Re:Tell HN: Heroku is Down (update: recovering as of 10PM PST) by ctrand on Friday June 15, 2012 @12:39AM (#4115031)
I thought I read somewhere that it was on Rackspace