News for hackers. Stuff that matters.
Re:Amazon DocumentDB, with MongoDB compatibility by mrep on Wednesday January 09, 2019 @11:51PM (#18871622)
Definitely because it was faster. Amazon's strategy is to launch new features ASAP and then rely on everyone having to be on-call to fix shit when it inevitably breaks in prod because they rushed to launch. I will admit that while their "operational excellence" is shit, the security engineers do have quite a bit of power to block launches so their security isn't as bad as the reliability.

However, the fact that writes aren't horizontally scalable makes it a laughable nosql database but it probably satisfies the checkmark for enough of their enterprise customers that it will be a mild success and they'll keep it on life support like simpledb forever until they implement a proper solution assuming there is enough demand for it.

Re:Amazon DocumentDB, with MongoDB compatibility by senderista on Thursday January 10, 2019 @12:46AM (#18871801)
I was there for the launch of a major AWS service where they had an entire separate team working on the next iteration since well before launch (because the initial design wasn’t even intended to be sustainable). They are happy to incur technical risk (and in this case, to eat major losses in hardware costs) in order to be first to market.
Re:Amazon DocumentDB, with MongoDB compatibility by Corrado on Thursday January 10, 2019 @05:51AM (#18872929)
We used MongoDB in my last job and I just want to say that I would have given up management of that beast in a heartbeat. We didn't stress MongoDB nearly enough to warrant all the effort required to construct it, monitor it, back it up, etc. Even if the performance was crappy, I would have lobbied hard to change to DocumentDB ASAP.
Re:Amazon DocumentDB, with MongoDB compatibility by halbritt on Thursday January 10, 2019 @11:41AM (#18875227)
While I don't love MongoDB, I don't find it to be especially difficult to run. I'm running ~200 instances of MongoDB with a small team and it consumes very little of my attention.

ElasticSearch on the other hand...

Re:Amazon DocumentDB, with MongoDB compatibility by bloomburger on Monday January 14, 2019 @08:33PM (#18908176)
Why is Elastic so difficult to run for you?
Re:Amazon DocumentDB, with MongoDB compatibility by adaptiveValleys on Thursday January 10, 2019 @06:55AM (#18873220)
I'm sure they are, so they a pass those lovely negative externalities onto the customer because they know it's in demand and only they provide that service.

If only they had a competitor that could launch the same products a few months later but offered higher reliability off the bat, that could eventually force Amazon to improve their reliability or risk losing customers long term.

Being first to market doesn't ensure eventual market dominance. Sure, it could give you important feedback. But if your product is subpar, the feedback will have a ton of noise and possibly be useless. Plus it's not worth creating negative externalities and earning the reputation.

Re:Amazon DocumentDB, with MongoDB compatibility by talawahdotnet on Thursday January 10, 2019 @09:30AM (#18874037)
You think AWS has a reliability problem for their database products? That's news to me. AWS often launches products with limited features, but security, durability and reliability tend to be the standard.

Reliability is the trickiest of the three because it requires the customer to architect their solution with multi-AZ support in mind, but AWS always provides the foundation for that architecture.

Could they, and should they provide more features and a better developer experience around building fault tolerant solutions? Absolutely! But I certainly don't think they have a bad reputation for reliability.

Re:Amazon DocumentDB, with MongoDB compatibility by halbritt on Thursday January 10, 2019 @11:42AM (#18875239)
From my perspective, performance and scaling issues are most likely to occur.
Re:Amazon DocumentDB, with MongoDB compatibility by nailer on Thursday January 10, 2019 @07:41AM (#18873401)
> If only they had a competitor that could launch the same products a few months later but offered higher reliability off the bat

Doesn't Azure Cosmos DB do this? From https://docs.microsoft.com/en-us/azure/cosmos-db/introductio...

> You can elastically scale throughput and storage, and take advantage of fast, single-digit-millisecond data access using your favorite API among SQL, MongoDB, Cassandra, Tables, or Gremlin.

Haven't used it though, so would welcome some real world experience.

Re:Amazon DocumentDB, with MongoDB compatibility by HeavyStorm on Friday January 11, 2019 @05:04AM (#18882263)
> If only they had a competitor that could launch the same products a few months later but offered higher reliability off the bat, that could eventually force Amazon to improve their reliability or risk losing customers long term.

They have, it's Azure. I'm even a little bit scared because no one here is mentioning CosmosDB... It seems to me that most of the community only knows aws products.

Re:Amazon DocumentDB, with MongoDB compatibility by sokoloff on Thursday January 10, 2019 @08:17AM (#18873580)
For how many customers do all of AWS flaws combined represent more than 2% of their production outages? I think it’s a very small number.
Re:Amazon DocumentDB, with MongoDB compatibility by HeavyStorm on Friday January 11, 2019 @04:59AM (#18882225)
Well, they are second to market this time around, Cosmos has had mongo api compatibility for a long time.
Re:Amazon DocumentDB, with MongoDB compatibility by talawahtech on Thursday January 10, 2019 @09:17AM (#18873953)
It definitely sounds like it sucks from the perspective of an internal AWS developer or SRE, but if the AWS systems are architected such that these internal failures aren't seen by end users then AWS's reliability reputation remains fully intact.

Customers are paying AWS so that their SREs don't get called, they don't care if the AWS SREs do as long as the system keeps running.

Based on the supporting quotes at launch from Capital One, Dow Jones and WaPo it sound like enough customers are ok with vertical write scalability and (pretty awesome) horizontal read scalability for now because it fits their use case and is better than what they had before.

Also consider that since the cluster management overhead has been removed from the customer, they can essentially "shard" by using a separate cluster for each sufficiently large service/org/dept, which might actually work out better for them in some respects.

Perfect is the enemy of good enough, the architecture might be laughable to you, but it is probably miles ahead of what the customer was using before.

Re:Amazon DocumentDB, with MongoDB compatibility by int_19h on Thursday January 10, 2019 @02:34AM (#18872177)
I suspect that most MongoDB users never get to the point where they need to horizontally scale (i.e. it gets chosen for fad reasons, not because they actually have something big enough to scale).

And the nice thing about this hypothesis, you can test it by looking how successful DocumentDB will turn out to be. ~

Re:Amazon DocumentDB, with MongoDB compatibility by tanilama on Thursday January 10, 2019 @01:40AM (#18871999)
AWS prioritizes launch above EVERYTHING. It is their strategy, to have market tells them what to build.

I think it works, and AWS has yet been brought down by this horizontal complexity. Quite an achievement, but might not be a satisfying experience for the engineers work there.

Re:Amazon DocumentDB, with MongoDB compatibility by talawahdotnet on Thursday January 10, 2019 @01:58AM (#18872054)
It makes sense in terms of feeling out the market as well. If this version of the service takes off it validates the decision to proceed with a more complex/scalable version and it gives them more customer feedback. Standard MVP best practices.

The downside is that a lot of their products lack polish which sucks. On the flip side even when they are launched with minimal features, they do tend to be reliable, durable and secure, which is important when it comes to data related services.

Re:Amazon DocumentDB, with MongoDB compatibility by danpalmer on Thursday January 10, 2019 @04:39AM (#18872641)
This is one of the main reasons why I don't like AWS services, everything just seems so half-finished. There's not a lot in AWS that I would trust enough to use in production.

I wonder how widespread this view is. I suspect it's more widespread than Amazon realise. They may have optimised into a local maximum where they get a lot of value from being first to market, but could potentially get more by being first to "viable to trust a business on".

Re:Amazon DocumentDB, with MongoDB compatibility by talawahdotnet on Thursday January 10, 2019 @08:54AM (#18873795)
I certainly agree that they seem half finished in terms of features and developer experience, but from the point of view of security and data durability they have an excellent reputation. They typically have a pretty good reliability story as well, but it relies on the customer architecture their solution to take advantage of multiple AZs/Regions, which is often not trivial.

As far as being "viable to trust a business on" the numbers don't lie, AWS is number one because customers are running their businesses on AWS. The fact that DocumentDB launched with supporting quotes from Capital One, Dow Jones and WaPo shows that customers were clamoring to use it even before GA.

Remember a lot of these customers are coming to AWS because they tried doing themselves and stuggled. When it comes to data, customers trust AWS more than they trust themselves, and rightly so.

Re:Amazon DocumentDB, with MongoDB compatibility by ctvo on Thursday January 10, 2019 @01:15PM (#18876359)
What's your definition of production ready? AWS services when launched "half-finished" still do not have outages, data lost or security issues. They also come with metrics and enough monitoring to support them in production. Those are the major checkboxes for production ready.

AWS also has not had a reputation for deprecating services it launches. I find very little risk in taking a dependency on something AWS releases.

Re:Amazon DocumentDB, with MongoDB compatibility by jjeaff on Friday January 11, 2019 @12:06AM (#18881149)
You mean if they used a different strategy, they might have more than the entire one third market share of the entire cloud hosting industry?
Re:Amazon DocumentDB, with MongoDB compatibility by manigandham on Friday January 11, 2019 @11:51AM (#18884773)
>> "viable to trust a business on"

They already are viable and trusted by multiple billion-dollar companies and governments.

Re:Amazon DocumentDB, with MongoDB compatibility by manigandham on Thursday January 10, 2019 @02:35AM (#18872179)
Apparently SimpleDB is still used quite a lot internally. As for their market tactics, there's no denying it works as their pace is accelerating and leaving everyone else in the dust. Most customers just want to pay some money and have a solution ready to go, they don't need infinite scaling from day 1, if ever.

This focus on actually meeting needs today is what keeps AWS on top while the others take 2 years to launch minor service upgrades.

Re:Amazon DocumentDB, with MongoDB compatibility by drb91 on Thursday January 10, 2019 @12:20AM (#18871725)
MongoDB is not horizontally scalable either is it?
Re:Amazon DocumentDB, with MongoDB compatibility by mrep on Thursday January 10, 2019 @12:31AM (#18871758)