Re:Tell HN: Heroku is Down (update: recovering as of 10PM PST)
by dangrossman on Friday June 15, 2012 @12:13AM
(#4114926)
Half the startup world is offline right now, yet the AWS status page is all greens with one "info" notice about EBS (which I doubt is the issue here). I'm glad to have moved off a fully AWS stack back to my own servers over a year ago. My uptime, bills, and stress level are all much improved.
Re:Tell HN: Heroku is Down (update: recovering as of 10PM PST)
by res0nat0r on Friday June 15, 2012 @12:33AM
(#4115007)
Sounds like half of the startup world hasn't spent the time or the money to design their service to be redundant on top of AWS.
Re:Tell HN: Heroku is Down (update: recovering as of 10PM PST)
by zeeg on Friday June 15, 2012 @12:38AM
(#4115024)
Fortunately for most, they dont have customers yet
Re:Tell HN: Heroku is Down (update: recovering as of 10PM PST)
by reddit_clone on Friday June 15, 2012 @12:47AM
(#4115048)
That made me laugh. Am I a bad person?
Re:Tell HN: Heroku is Down (update: recovering as of 10PM PST)
by rhizome on Friday June 15, 2012 @12:47AM
(#4115049)
The sales pitch is kind of that it's already redundant. You know, RAID and load balancers and all.
Re:Tell HN: Heroku is Down (update: recovering as of 10PM PST)
by fusiongyro on Friday June 15, 2012 @12:45AM
(#4115041)
That's hardly surprising. The groupthink on cloud services is that they magically make everything scalable, cheap and easy. Making redundant software is hard work.
Re:Tell HN: Heroku is Down (update: recovering as of 10PM PST)
by michaelfairley on Friday June 15, 2012 @12:17AM
(#4114943)
Definitely an EBS issue. Our (EBS backed, Heroku hosted) DB was returning queries more and more slowly leading up to the outage.
Re:Tell HN: Heroku is Down (update: recovering as of 10PM PST)
by atlasom on Friday June 15, 2012 @12:33AM
(#4115008)
They posted an update on amazon: We continue to investigate this issue. We can confirm that there is both impact to volumes and instances in a single AZ in US-EAST-1 Region. We are also experiencing increased error rates and latencies on the EC2 APIs in the US-EAST-1 Region.
Also Amazon Relational Database Service (N. Virginia) is unavailible.
Seems like its snowballing.
Re:Tell HN: Heroku is Down (update: recovering as of 10PM PST)
by res0nat0r on Friday June 15, 2012 @01:14AM
(#4115140)
RDS actually uses EBS so it is most likely the same underlying issue.
Re:Tell HN: Heroku is Down (update: recovering as of 10PM PST)
by ajasmin on Friday June 15, 2012 @12:27AM
(#4114983)
Out of curiosity do we know if http://status.aws.amazon.com/ is hosted on AWS?
Re:Tell HN: Heroku is Down (update: recovering as of 10PM PST)
by sprout on Friday June 15, 2012 @12:32AM
(#4115005)
It's a key design constraint of status.aws.amazon.com that it not depend on any AWS services. (Or so I've heard.)
Re:Tell HN: Heroku is Down (update: recovering as of 10PM PST)
by ceejayoz on Friday June 15, 2012 @12:31AM
(#4115002)
status.aws.amazon.com resolves to 207.171.185.167 for me.
That IP isn't in the EC2 IP ranges (https://forums.aws.amazon.com/ann.jspa?annID=1528), so at the very least it's not hosted on EC2.
EDIT: Various non-Heroku EC2-East-based sites (e.g. Quora) seem to be down as well, lending more evidence to this being an EC2/EBS outage.
1: http://status.aws.amazon.com/