Re:Netflix was experiencing issues
by AYBABTME on Tuesday February 03, 2015 @07:51PM
(#8994645)
Really looking forward to read about what happened. I know they have great resiliency measures in place, I'd like to know if they worked, in what measure, how they failed or how they weren't enough. Or if there was anything they could have done.
Re:Netflix was experiencing issues
by johansch on Tuesday February 03, 2015 @07:56PM
(#8994672)
Great resilience measures? Like depending on AWS that's seemingly going down like one full day per year?
I guess what I'm trying to say is that one the one hand i see netflix having lots out outages, on the other hand being celebrated as some sort of thought leader on resilicency/high availability. Good tech/open source marketing goes a long way in certain crowds, it seems.
It's not like doing lots of stateless transactions/distributing read-only content is a really hard problem by now. Akamai has done it well for ages. Yet Netflix while being celebrated primarily for their tech marketing in this area is struggling.
Re:Netflix was experiencing issues
by mikeyouse on Tuesday February 03, 2015 @08:36PM
(#8994821)
During the evening hours, Netflix represents over 35% of all internet traffic in the US. That is an insane demand to be able to service, but they've done extremely well in my opinion. Much of their tech is open-sourced leading to much better practices industry-wide and they're transparent when things go wrong.
Here's an example of their preemptive work to deal with the loss of AWS/ELB regions:
Is there any other service with a library well over a petabyte in size that delivers multiple terabits/second worldwide to millions of customers with better reliability? Maybe YouTube with the backing of a company worth $300B more than Netflix?
Re:Netflix was experiencing issues
by johansch on Tuesday February 03, 2015 @08:37PM
(#8994831)
Again you are confusing openness with availability. I do agree they are open. I don't really see the connection between their openness and their performance though.
Re:Netflix was experiencing issues
by mikeyouse on Wednesday February 04, 2015 @03:53AM
(#8995920)
I think my last paragraph was pertinent to your question, is there anyone providing the volume of traffic to millions of worldwide customers comparable to Netflix who is more reliable?
Re:Netflix was experiencing issues
by thezilch on Tuesday February 03, 2015 @08:39PM
(#8994838)
xyz? S3 is on the same link. Even if they are additive -- assume the S3 downtime doesn't overlap with EC2 -- they are still at less than a day, half day, quarter day...
johansch is trying to paint AWS -- the culmination of its products (EC2, S3, "xyz", etc) -- as something that is down for day(s) a year. We don't (have to) work for these providers to know the real truth and shut down such FUD.
Re:Netflix was experiencing issues
by AYBABTME on Tuesday February 03, 2015 @08:13PM
(#8994733)
Great resilience measure, in spite of their choice to use AWS.
Any infrastructure will involve downtime, be it your own hardware or some cloud provider. Probabilities will vary, but they're always there. Despite their hosting solution, Netflix is doing (or showing) extra effort in dealing with the reality of failures. I'm interested in that bit.
Sure it might be a good idea to diversify their cloud providers, although I'm not sure this might be involved here, since AWS seems to be doing fine at this time.
I guess what I'm trying to say is that one the one hand i see netflix having lots out outages, on the other hand being celebrated as some sort of thought leader on resilicency/high availability. Good tech/open source marketing goes a long way in certain crowds, it seems.
It's not like doing lots of stateless transactions/distributing read-only content is a really hard problem by now. Akamai has done it well for ages. Yet Netflix while being celebrated primarily for their tech marketing in this area is struggling.
Here's an example of their preemptive work to deal with the loss of AWS/ELB regions:
http://techblog.netflix.com/2013/12/active-active-for-multi-...
An an example of their post-mortem after deploying Node.js with a bad handler:
http://techblog.netflix.com/2014/11/nodejs-in-flames.html
Is there any other service with a library well over a petabyte in size that delivers multiple terabits/second worldwide to millions of customers with better reliability? Maybe YouTube with the backing of a company worth $300B more than Netflix?
https://cloudharmony.com/status-1year-group-by-regions
This is HN.. You shouldn't use dodgy language like "seemingly" to avoid doing homework and citing sources.
johansch is trying to paint AWS -- the culmination of its products (EC2, S3, "xyz", etc) -- as something that is down for day(s) a year. We don't (have to) work for these providers to know the real truth and shut down such FUD.
Any infrastructure will involve downtime, be it your own hardware or some cloud provider. Probabilities will vary, but they're always there. Despite their hosting solution, Netflix is doing (or showing) extra effort in dealing with the reality of failures. I'm interested in that bit.
Sure it might be a good idea to diversify their cloud providers, although I'm not sure this might be involved here, since AWS seems to be doing fine at this time.
And apparently it started right before my son's designated Sesame Street time. Boo.
Something to be said for local copies of programs that really matter.
We're aware some members are experiencing technical difficulties on the web site in all regions. We hope to resolve this asap.