News for hackers. Stuff that matters.
Re:Ask HN: Is S3 down? by mwfj on Tuesday February 28, 2017 @01:27PM (#13756267)
I guess their bizarre thinking is something along the lines of: "unless we have proof that noone can access the service, we won't change the indicator from green to yellow.

Seriously: I don't understand why you guys stay with AWS.

Re:Ask HN: Is S3 down? by cagataygurturk on Tuesday February 28, 2017 @04:17PM (#13757932)
Because you perceive public clouds only as virtual machine providers, that you can replace with other provider in two days. A detailed cloud migration consists of replacing some parts of your software to use managed services provided by a specific cloud provider, and AWS is still has the best service offerings IMHO. When you use these services carefully also you will see that AWS is very cheap and reliable enough. Outages like today's are happening in every platform and it is possible to mitigate them.

You can use Adwords as a self-service user. Without knowing so much of details you can run your ads but also you can bery easily ruin your budget. But many enterprise customers use it very differently than those users and they are extremely optimizing the cost. Cloud is the same. If you don't know how big customers use AWS, it is normal that you are surprised because AWS is still leading the market.

You say GCP is better than AWS. Which part is better? GCP does not have many services of AWS we benefit from. How can you compare totally different providers? You can only say AWS EC2 is worse than GCP. But you cannot compare whole platforms in one sentence.

Re:Ask HN: Is S3 down? by johansch on Wednesday March 01, 2017 @12:19PM (#13765786)
(Sorry, I'm late to reply, but since you addended your comment you might still be listening...)

After spending a year evaluating both AWS and GCP (with an emphasis on their managed database services; both SQL and no-SQL) my general feeling is this:

"Microsoft Windows is to Unix as AWS is to GCP".

(Or perhaps closer to the truth: "VMS is to Unix as AWS is to GCP".)

Baically AWS services seem like they are badly designed by buerocratic mediocre engineers following some bureocratic template for "a service".

GCP feels a lot saner (both API- and UI/console-wise). I often got the feeling it's designed by people who:

a) are smart and well-rounded in terms of experiences. It does take cleverness and experience to design something elegant that is also useful.

b) take pride in their work (it does show)

(And then, as a bonus: It's cheaper!)

Re:Ask HN: Is S3 down? by cagataygurturk on Wednesday March 01, 2017 @12:57PM (#13766313)
You talk about SQL and No-SQL as managed services and it shows that your experience is limited to a classical application consisting of virtual machines and some data storage. However these are not the only services offered by both platforms and currently AWS has a richer feature set. For example Lambda and its deep integration with whole AWS platform is the biggest game changer from my point of view. If we are talking about virtual machines and databases, I can accept this comparison. However we are talking about 30+ services, some of them are even not available somewhere else and solving serious business problems in production and at scale. It is very wrong to put everything into basket and compare. Maybe GCP has better pub/sub service and AWS has better object storage. These should be compared seperately. Answering to your question, why do we still stay at AWS, because it is solving our problems in the most cost effective way and with reduced complexity, we are happy with it.
Re:Ask HN: Is S3 down? by johansch on Wednesday March 01, 2017 @01:12PM (#13766502)
You're probably assuming too much again :)

I specifically spent a lot of time on Lambda and found it quite annoying compared to GCP AppEngine. So much bureaucracy. Just this thing that you have to specifically register every single Lambda API call and its parameters using an interface built by non-thinking people.. Sheesh.

For on-demand processing I just want a single HTTP-ish entry point, like AppEngine provides. (That way I can I move my service between different providers, if I wanted to move away from e.g. AWS.)

Re:Ask HN: Is S3 down? by johansch on Wednesday March 01, 2017 @01:59PM (#13767013)
Anyway, I just updated my HN profile with more details about my experience. Please visit it to judge if I might know what I'm talking about.
Re:Ask HN: Is S3 down? by cagataygurturk on Wednesday March 01, 2017 @05:15AM (#13762658)
Sorry for endless number of typos and mistakes. Obviously I was sleepy while I was writing this.
Re:Ask HN: Is S3 down? by gtsteve on Tuesday February 28, 2017 @02:28PM (#13756971)
> Seriously: I don't understand why you guys stay with AWS.

Personally I've been using it for ages and I know most services inside and out. They do suffer downtime in some regions occasionally, but it'd be too expensive at this point to move.

And who doesn't suffer downtime? You can't avoid it; you just need a plan to deal with it. For example, having a backup replica bucket in another region and the ability to quickly switch your CDN over would probably be a good idea here; that's what I did.

If you want to go further you can replicate your data to another cloud provider entirely and use low TTLs to switch to a backup CDN if your system is that mission-critical (in the event of a worldwide AWS failure doomsday scenario).

All systems will fail you and it's our responsibility as IT professionals to have a plan to mitigate this.

Re:Ask HN: Is S3 down? by nicolaslem on Tuesday February 28, 2017 @04:26PM (#13758020)
Low TTL on DNS entries might do more harm than good: if your DNS provider gets seriously DDoS, being able to rely on caches can save the day.

Anyway, I agree with your conclusion.

Re:Ask HN: Is S3 down? by johansch on Tuesday February 28, 2017 @02:43PM (#13757127)
Sunk cost fallacy.

I do agree that we should all plan for failures.

However, I also think it's a sign of failure in planning and architecture foresight if it's too expensive to move away from a particular cloud provider.

Re:Ask HN: Is S3 down? by froogle on Tuesday February 28, 2017 @03:03PM (#13757318)
The sunk cost fallacy is when you (irrationally) decide to stick with what you're doing purely because you've already spent a lot of resources on it. It doesn't apply when you've done an economic analysis and found out it doesn't make sense to swap.

There are plenty of cases where it just wouldn't make sense to switch after looking at the costs, opportunity costs, etc. For example, if his site makes him $10 a month, outages cost him $1 a month that could be mitigated by moving, and it would cost $1000 of labor to swap providers. (Depends on interest rates.)

Perhaps it was originally a failure to not have a plan to easily move from a provider, but it doesn't seem unreasonable to me that right now it may cost too many hours of work to justify the move.

Re:Ask HN: Is S3 down? by gtsteve on Tuesday February 28, 2017 @04:33PM (#13758122)
It's not as though it would be impossible; our integration with AWS isn't that deep, it's not as though we use DynamoDB for our core data store or anything like that. But even migrating from one traditional datacenter to another isn't easy from an operational point of view.

There needs to be a clear financial win. Even taking into account the failures we've seen so far, I don't see a compelling reason to leave AWS.

Re:Ask HN: Is S3 down? by johansch on Tuesday February 28, 2017 @03:13PM (#13757415)
(You're right, I used that term incorrectly.)

Still stand behind the other two points I made in that post though.

Re:Ask HN: Is S3 down? by rattray on Tuesday February 28, 2017 @01:35PM (#13756355)
> I don't understand why you guys stay with AWS.

Who do you recommend instead (assuming in-house or Hetzner-equiv is out of reach)? Google Cloud? Azure? Rackspace?

Re:Ask HN: Is S3 down? by johansch on Tuesday February 28, 2017 @01:37PM (#13756370)
Google Cloud if you're looking for something similar. It's just so much better and cheaper. I think a lot of the resistance here towards that kind of move is just because people are inherently lazy and they aren't paying the bill themselves.

(I'm guessing a relatively large part is also selfish attachment to the market leader because of employment reasons. I hate wasting money, both for myself and for my employer, so I don't really understand this kind of thinking - but I do understand how it could flourish in a venture capital-rich time/locale.)

I also recommend reading:

https://thehftguy.com/2016/06/15/gce-vs-aws-in-2016-why-you-...

Re:Ask HN: Is S3 down? by debaserab2 on Tuesday February 28, 2017 @01:53PM (#13756558)
Google Cloud doesn't exactly have the greatest reliability/uptime either.
Re:Ask HN: Is S3 down? by eicnix on Tuesday February 28, 2017 @02:04PM (#13756697)
https://status.cloud.google.com/summary tells a different story or do you have other information?

I have used GCP for some time without being affected from any incident.

Re:Ask HN: Is S3 down? by debaserab2 on Tuesday February 28, 2017 @03:03PM (#13757317)
I'm not sure what you mean. If anything that link underscores my point. GCE has absolutely had it's own catastrophic errors. Remember last April when ALL instances in ALL regions went down?

https://status.cloud.google.com/incident/compute/16007?post-...

Re:Ask HN: Is S3 down? by miken123 on Tuesday February 28, 2017 @06:06PM (#13759139)
At least Google has a post-mortem, at AWS everything would still show up green with some random note about 'increased error rates'.
Re:Ask HN: Is S3 down? by boulos on Tuesday February 28, 2017 @04:16PM (#13757927)
While I agree that was a horrific outage for us, there's a big difference between no external connectivity for a few minutes (note: internal IPs still worked fine, as did access to APIs through that mechanism) and "ALL instances in ALL regions went down".

Disclosure: I work on Google Cloud (and wouldn't want to be an incident responder at AWS today...)

Re:Ask HN: Is S3 down? by eicnix on Tuesday February 28, 2017 @03:14PM (#13757418)
The GCP services are usually within their SLA target so I don't see the problem with the incidents. So you know what you buy and can take actions if you need a higher SLA for your application.
Re:Ask HN: Is S3 down? by debaserab2 on Tuesday February 28, 2017 @03:26PM (#13757508)
> so I don't see the problem with the incidents

All instances going down in all regions is an order of magnitude worse than a single service going down in a single region. You're deluding yourself if you think GCE is any more reliable than any other reputable cloud hosting platform.

Re:Ask HN: Is S3 down? by briffle on Tuesday February 28, 2017 @02:19PM (#13756876)
That is a pretty awesome page.. way better than a page full of green icons, during an obvious outage... I like that they have writeups a few days after the incidents....
Re:Ask HN: Is S3 down? by joatmon-snoo on Tuesday February 28, 2017 @01:44PM (#13756451)
Google also doesn't have the best record for developer tools.
[dead]
Re:Ask HN: Is S3 down? by ecliptik on Tuesday February 28, 2017 @02:37PM (#13757056)
too soon
Re:Ask HN: Is S3 down? by johansch on Tuesday February 28, 2017 @02:56PM (#13757250)
;)
Re:Ask HN: Is S3 down? by chebum on Tuesday February 28, 2017 @03:11PM (#13757401)
GC's CDN doesn't cache files bigger than 4Mb. No Windows VMs. Bound to AWS for these 2 reasons.
Re:Ask HN: Is S3 down? by dragonwriter on Tuesday February 28, 2017 @03:18PM (#13757454)
Re:Ask HN: Is S3 down? by mrmaximus on Tuesday February 28, 2017 @06:58PM (#13759533)
As already mentioned, they do have Windows VM's but there are some caveats that indicate it's not fully baked yet. 1.) They require that each VM MUST have a public IP address so that Windows can talk to an activation server every 30 days. 2.) You cannot yet bring your own license.
Re:Ask HN: Is S3 down? by vgt on Tuesday February 28, 2017 @03:26PM (#13757510)
Someone else already mentioned Windows VMs.

Looks like CDN has a 10MB limit:

https://cloud.google.com/cdn/docs/caching

(work at Google Cloud)

Re:Ask HN: Is S3 down? by kohuma on Tuesday February 28, 2017 @02:07PM (#13756749)
What about something like B2 from https://www.backblaze.com/ ?
Re:Ask HN: Is S3 down? by Twirrim on Wednesday March 01, 2017 @11:57AM (#13765506)
S3 in a single region is based out of multiple data centres / availability zone, with data distributed so that the loss of a single availability zone won't impact either data availability or durability, even to the point of being comfortable with complete physical destruction of an AZ. The same applies for Azure, GCP etc.

B2 is based out of a single DC (or at least, was at launch and I don't see anything that suggests that has changed?) You've got to decide what's most important to you. Data persistence or $$$.

Re:Ask HN: Is S3 down? by pmalynin on Tuesday February 28, 2017 @01:40PM (#13756400)
OVH
Re:Ask HN: Is S3 down? by LeoHaggins on Tuesday February 28, 2017 @01:57PM (#13756606)
Bad idea there, support is horrible.
Re:Ask HN: Is S3 down? by rspeer on Tuesday February 28, 2017 @02:14PM (#13756835)
OVH doesn't even want to take my money to keep my server running. Their auto-billing process is busted and when it goes wrong they just delete your server.
Re:Ask HN: Is S3 down? by fishnchips on Tuesday February 28, 2017 @02:29PM (#13756975)
That's not what I've seen. I misconfigured my auto-billing and got paged in the middle of the night by nodes mysteriously disappearing, but they released those machines minutes after my CC went through. Not that I'm a big fan of OVH but if you design your system to allow for failure you can't match their value for money.
Re:Ask HN: Is S3 down? by jacquesm on Tuesday February 28, 2017 @02:08PM (#13756759)
What is your last datapoint on that?

The last year or two has seen a remarkable improvement according to those customers of mine that host there.

Re:Ask HN: Is S3 down? by derefr on Tuesday February 28, 2017 @05:12PM (#13758633)
I think it's more, "if the service can't do what people need it to do, that's a problem; if the service cluster gets wedged hard enough to stop responding to the requests of our monitoring system, that's a failure."

Which would make sense (and is sorta-kinda a best-practice) if Amazon wrote services such that they "crashed early"—but instead they're seemingly written so the backend lock up and be rendered completely useless at "doing its job" but will continue to run just fine.

Either of those two design decisions is potentially a good thing on its own, but they need to be considered in light of one-another if you want your status page to make any sense. If you want to report cluster failures, code your clusters to actually fail. If you want to keep your clusters up, write your monitoring checks as whole-stack acceptance tests.

Re:Ask HN: Is S3 down? by notyourwork on Tuesday February 28, 2017 @09:35PM (#13760463)
> Seriously: I don't understand why you guys stay with AWS.

You don't seem to have enough experience to comment on the issue.

Re:Ask HN: Is S3 down? by johansch on Wednesday March 01, 2017 @03:15PM (#13767860)
Please visit this comment sub-tree:

https://news.ycombinator.com/item?id=13765786

Re:Ask HN: Is S3 down? by notyourwork on Friday March 03, 2017 @02:21PM (#13785437)
That is a regurgitation of your opinion without any facts.

Comparing technology and saying "it seems" or "i feel" isn't really a good argument to convince me one way or the other.

Re:Ask HN: Is S3 down? by tlogan on Tuesday February 28, 2017 @02:09PM (#13756766)
> Seriously: I don't understand why you guys stay with AWS.

I tried them all and Amazon is still the best.

Re:Ask HN: Is S3 down? by cgag on Tuesday February 28, 2017 @04:30PM (#13758078)
Postgres on RDS
Re:Ask HN: Is S3 down? by boulos on Tuesday February 28, 2017 @04:41PM (#13758231)
Come to NEXT in a week! :).
Re:Ask HN: Is S3 down? by espeed on Tuesday February 28, 2017 @08:46PM (#13760205)
Any chance UDF iterators for Cloud Bigtable are in the works?

Being able to run distributed D4M/GraphBLAS queries in Cloud Bigtable would be killer.

"From NoSQL Accumulo to NewSQL Graphulo: Design and Utility of Graph Algorithms inside a BigTable Database" https://arxiv.org/pdf/1606.07085.pdf