News for hackers. Stuff that matters.
Re:You Are Not Google (2017) by throwaway2048 on Thursday April 04, 2019 @06:48PM (#19577867)
Managed services still have plenty of unexplained goings-on, and 3AM pages.
Re:You Are Not Google (2017) by aprdm on Thursday April 04, 2019 @07:44PM (#19578263)
We moved some stuff from AWS back to on prems because it broke less often and in more obvious ways.
Re:You Are Not Google (2017) by diminoten on Thursday April 04, 2019 @07:08PM (#19578004)
Said like a person who hasn't actually ever converted. It's nothing like that at all.

12 outages since 2011, and none of them are anything like what you're describing: https://en.wikipedia.org/wiki/Timeline_of_Amazon_Web_Service...

Re:You Are Not Google (2017) by bsagdiyev on Thursday April 04, 2019 @07:19PM (#19578100)
We've moved from on-prem to AWS fully and we see random issues all the time while their status page shows all green, so I feel you probably have a small amount of resources in use with them or something, because what you're saying doesn't jive with what we see daily. I see you've also copy-pasted your response to other comments too.
Re:You Are Not Google (2017) by diminoten on Thursday April 04, 2019 @07:45PM (#19578271)
Can you actually quantify any of this or are you asking me to trust you? What I gave is an objective standard, what you've given so far is "trust me I'm right".
Re:You Are Not Google (2017) by bsagdiyev on Thursday April 04, 2019 @08:10PM (#19578406)
Are you just ignoring that the cloud isn't a the savior for everyone because it furthers your own agenda, either publically or personally? We spend the GDP of some nations with AWS yearly, so I guarantee you're not at our scale to see these sorts of issues that most definitely are not caused by us and are indeed issues with AWS as confirmed by our account rep.
Re:You Are Not Google (2017) by diminoten on Thursday April 04, 2019 @10:38PM (#19579171)
There are nations that have very tiny GDPs (and AWS is very expensive) so that's not saying much, and I didn't say AWS was flawless, I said that AWS was a hell of a lot better than anything you could come up with unless you're literally at Amazon scale (and we both know you arent), and nearly none of your software's problems are AWS's fault.

Using AWS has been a legitimate excuse for an outage or service delivery issue a dozen times since 2011. The end. Write your apps to be more resilient if you've had more than that many outages at those times (and honestly even those outages weren't complete).

Re:You Are Not Google (2017) by kbenson on Friday April 05, 2019 @12:14AM (#19579646)
> AWS was a hell of a lot better than anything you could come up with unless you're literally at Amazon scale

AWS is a hell of a lot better than most people here can come up with for solving AWS specific set of problems and priorities. But those problems and priorities generally do not match the problem space of the people using it exactly.

For example, AWS has a lot of complexity for dealing with services and deployment because it needs to be versatile enough to meet wildly different scenarios. In designing a solution for one company and their needs over the next few years, you wouldn't attempt to match what AWS does, because the majority of companies use only a small fraction of the available services, so that wouldn't be a good use of time and resources.

AWS is good enough for very many companies so they appeal to large chunks of the market, but let's not act like that makes them a perfect or "best" solution. They're just a very scaleable and versatile solution so it's unlikely they can't handle your problem. You'll often pay more for that scaleability and versatility though, and if you knew perfectly (or within good bounds) what to expect when designing a system, it's really not that hard to beat AWS on a cost and growth level with a well designed plan.

Edit: Whoops, s/dell/well/, but it probably works either way... ;)

Re:You Are Not Google (2017) by bsagdiyev on Friday April 05, 2019 @01:10AM (#19579884)
I'm starting to think this person refuses to be logical, not directed at you kbenson. PlayStation Network ran fine for years in our own datacenters, we decided to move to AWS instead of dealing with acquiring and maintaining our own hardware. Trust me, Sony isn't lacking some very bright people, we just don't want to deal with on-prem anymore, so yeah we'll throw ridiculous money at them for that pleasure.

diminoten -- relax, take a breath. Your rude and condescending tone is unnecessary. We don't see eye-to-eye, but I'm not discounting your experience. I can't say I'm getting the same vibe from you.

[dead]
Re:You Are Not Google (2017) by gcommer on Friday April 05, 2019 @07:18PM (#19587957)
You do realize we can scroll up half a page and see you were the first person to levy a personal attack, right?
Re:You Are Not Google (2017) by diminoten on Friday April 05, 2019 @12:41PM (#19584349)
I think the only thing you wrote here I would point out is that you seem to vastly underestimate the operational cost of running your own in-house infrastructure. You're comparing AWS costs to hardware costs, but that's not what AWS gives you, it lets you restructure how you task your entire SA team. You still need them, but they can now work on very different issues, and you don't need to hire new people to work on the things they are now freed up to work on.

And again, I cannot over emphasize how much more control over your own time AWS gives you. It's night/day, and discounting that is a mistake.

Re:You Are Not Google (2017) by bsagdiyev on Thursday April 04, 2019 @08:01PM (#19578355)
Without breaking my employer confidentiality agreement? No. But you basing off reported outages is you trusting Amazon in the same way you don't trust me, that is, on their word.
Re:You Are Not Google (2017) by diminoten on Thursday April 04, 2019 @08:04PM (#19578371)
I'd rather trust a corporation providing some information over an individual providing absolutely nothing, especially when that corporation's information matches with my own internal information.

The reality is, if you're having problems with AWS, it's you, and not AWS, for 99.9999999% of your problems. Continuing to pretend it's AWS is a face-saving, ego protecting activity that no rational person plays part in.

Re:You Are Not Google (2017) by ToFundorNot on Thursday April 04, 2019 @09:06PM (#19578695)
Which is funny because I've had an instance go down. I don't have ridiculously high volume, or distributed:

-One instance -No changes to the config -I'm the only person with access -No major outages at the time

It went down, and the AWS monitor didn't actually see it go down until 45 minutes later, which it needs to be down for a certain amount of time before their techs will take a look.

It was my first time using AWS, and I didn't want to risk waiting for tech so I rebooted the instance and it started back up again. I have no idea why, but it failed with out reason, and on reboot worked like it always did.

My point is that AWS has been solid, but they are like anything else, there are tradeoff's in using their service, and they aren't perfect.

Re:You Are Not Google (2017) by phamilton on Thursday April 04, 2019 @09:39PM (#19578881)
I don't know the last time I had an instance go down. Not because it doesn't happen, but because it's sufficiently unimportant that we don't alert on it. Our ASG just brings up another to replace it.

Many applications won't be as resilient. That's the trade-off. We don't have a single stateful application. RDS/Redis/Dynamo/SQS are all managed by someone else. We had to build things differently to accommodate that constraint, but as a result we have ~35M active users and only 2 ops engineers, who spend their time building automation rather than babysitting systems.

If you lean in completely, it's a great ecosystem. Otherwise it's a terrible co-lo experience.

Re:You Are Not Google (2017) by bsagdiyev on Thursday April 04, 2019 @10:22PM (#19579087)
Funny enough, that exact scenario is covered in the certification exams too, and the correct answer is to do what you did. An ASG will fix too like another poster said, also.
Re:You Are Not Google (2017) by diminoten on Thursday April 04, 2019 @10:31PM (#19579136)
Yeah, you just demonstrated why AWS is keen on you having backups to your services on their platform. You failed to do that (follow their guidance) and suffered an outage because of it. How exactly is that AWS's fault?

MY point is that AWS is very solid, and while there are plenty of trade offs, to be sure, the tradeoff is "operational" vs. "orchestration", and operational doesn't let you decide when to work on it whereas orchestration does.

Re:You Are Not Google (2017) by jacoblambda on Thursday April 04, 2019 @08:59PM (#19578662)
While I want to avoid getting into this argument, what you are saying is the same as "well it works on my machine" and "there can't be anything wrong with Oracle Database because Oracle says there are no bugs."
Re:You Are Not Google (2017) by diminoten on Thursday April 04, 2019 @10:34PM (#19579155)
No, what I'm saying is, "None of your problems are consistent across use cases, therefore they're your problems not the system being used."

I haven't actually said anything about my own experience, so it's funny you claim I have...

Re:You Are Not Google (2017) by jacoblambda on Friday April 05, 2019 @02:08AM (#19580117)
"I'd rather trust a corporation providing some information over an individual providing absolutely nothing, especially when that corporation's information matches with my own internal information."

Ah, I had assumed that your internal information was from experience, either your own or your organisation's. Since that is not the case I am curious where your "internal information" comes from considering you completely disregarded @bsagdiyev's personal experience.

Re:You Are Not Google (2017) by diminoten on Friday April 05, 2019 @12:42PM (#19584368)
What part of what I said makes you think my internal information isn't from experience? Just to be clear; it is. I haven't described my specific experience, so claiming I said "it works perfectly for me" is not something I've claimed.

What you tried to say was I was claiming that since it worked for me it was therefore good. That isn't the case. I'm saying because it worked for me AND EVERYBODY ELSE, it's therefore good.

Re:You Are Not Google (2017) by toomuchtodo on Thursday April 04, 2019 @09:06PM (#19578700)
It's bad enough that a Chrome extension exists to tease out real info from the lies that is the AWS status page:

https://chrome.google.com/webstore/detail/real-aws-status/ka...

Re:You Are Not Google (2017) by jrsdav on Thursday April 04, 2019 @10:45PM (#19579205)
How about network partitions across availability zones? Happens all the time for us, so much in fact that we had to build a tool to test connectivity across AZs just to correlate outages and find the smoking gun.
Re:You Are Not Google (2017) by stephenr on Friday April 05, 2019 @12:08AM (#19579616)
AWS status page is notorious for not indicating there is an issue either at all, or until well after the event began.
Re:You Are Not Google (2017) by adrianN on Friday April 05, 2019 @12:57AM (#19579833)
When your Redshift instance locks up, it doesn't end up on Wikipedia.