News for hackers. Stuff that matters.
Re:Dynamo vs. Cassandra: Systems Design of NoSQL Databases (... by etaioinshrdlu on Saturday December 14, 2019 @02:47PM (#21791709)
This is the key idea behind these databases. It is a good way to design a hash table to scale seamlessly. https://en.wikipedia.org/wiki/Consistent_hashing
Re:Dynamo vs. Cassandra: Systems Design of NoSQL Databases (... by tyingq on Saturday December 14, 2019 @08:13AM (#21789345)
I suppose interest in this is rising since AWS just announced managed Cassandra.
Re:Dynamo vs. Cassandra: Systems Design of NoSQL Databases (... by tlunter on Saturday December 14, 2019 @10:13AM (#21789839)
I didn't see if there was a re:invent talk about it, but is it actuallly Cassandra under the hood? It seemed like it might just be the Cassandra API akin to Aurora being MySQL.
Re:Dynamo vs. Cassandra: Systems Design of NoSQL Databases (... by tyingq on Saturday December 14, 2019 @10:45AM (#21790038)
It happens to be Cassandra, but that did make me think about the way Amazon brands the Postgres compatible Aurora as "Aurora PostgreSQL".

That's pretty lousy of them to take advantage of the name. I imagine the uptake would be lower if it weren't in the name, and they had to settle for just saying "Postgres Compatible" in the description.

I also imagine AWS would come after me if I launched "XYZ Fargate" or similar.

Re:Dynamo vs. Cassandra: Systems Design of NoSQL Databases (... by scarface74 on Saturday December 14, 2019 @12:15PM (#21790577)
There are two separate offerings. AWS offers Aurora/Postgres which is a fork of Postgres with Amazon’s own code and there is regular RDS/Postgres which is basically managed Postgres.
Re:Dynamo vs. Cassandra: Systems Design of NoSQL Databases (... by tyingq on Saturday December 14, 2019 @12:48PM (#21790825)
I'm not talking about RDS.

I'm talking about "Amazon Aurora PostgreSQL". That's what they call it. See this page, for example: https://aws.amazon.com/quickstart/architecture/aurora-postgr...

As mentioned, they likely wouldn't tolerate a "Tyingq Typhoon Fargate" that was my Fargate clone.

Re:Dynamo vs. Cassandra: Systems Design of NoSQL Databases (... by scarface74 on Saturday December 14, 2019 @01:17PM (#21791066)
It is Postgres. It’s using the same source code as a base and it’s compatible with all Postgres tools.
Re:Dynamo vs. Cassandra: Systems Design of NoSQL Databases (... by tyingq on Saturday December 14, 2019 @01:49PM (#21791277)
The storage backend isn't Postgres, and I assume the repeated use of the words "compatible" and "wire protocol" is on purpose, so they can continue to change it.
Re:Dynamo vs. Cassandra: Systems Design of NoSQL Databases (... by scarface74 on Saturday December 14, 2019 @02:31PM (#21791602)
Who cares about the “storage backend”? How does that affect clients?
Re:Dynamo vs. Cassandra: Systems Design of NoSQL Databases (... by sjwright on Saturday December 14, 2019 @05:09PM (#21792650)
I realise the parent comment is being voted down, but I think it’s a good point. If you’re buying a managed service, why should it matter if Amazon twiddled with how it stores data? What matters is that it behaves exactly like PostgreSQL in every way—which I’m led to believe it does.

There may be marginal resultant performance characteristics but they’re unlikely to be significant or wildly non-linear. My understanding is that this isn’t a storage engine rewrite, but a modification to the IO layer at the bottom of the storage engine.

Still, if you want “pure” anything, run it yourself.

Re:Dynamo vs. Cassandra: Systems Design of NoSQL Databases (... by meddlepal on Saturday December 14, 2019 @05:03PM (#21792611)
Clients no, but if you have had a Postgres DBA optimize your database to take advantage of known Postgres storage backend behavior you may be in for unexpected performance degradation under the assumption "it's just Postgres".

That said, I dust that's pretty uncommon.

Re:Dynamo vs. Cassandra: Systems Design of NoSQL Databases (... by scarface74 on Saturday December 14, 2019 @05:37PM (#21792825)
Well, you get the same problem if you have “network administrators” who took one AWS certification and call themselves “AWS Consultants”.

In both cases you end up with suboptimal solutions. The lesson to learn is not that AWS shouldn’t be making storage optimizations, it’s that you don’t depend on a bunch of old school net ops “lift and shifters” who didn’t take the time to learn the environment and who think that the cloud is just an overpriced colo.

Re:Dynamo vs. Cassandra: Systems Design of NoSQL Databases (... by scarface74 on Saturday December 14, 2019 @12:13PM (#21790563)
Aurora is basically a fork of Mysql that is more tightly integrated with AWS.

On the other hand, DocumentDB with Mongo Support doesn’t use any code from Mongo.

Re:Dynamo vs. Cassandra: Systems Design of NoSQL Databases (... by paulddraper on Saturday December 14, 2019 @11:56AM (#21790447)
AFAIK Aurora MySQL is largely MySQL code.

That's certainly the case at least for Aurora PostgreSQL, but then again, Aurora PostgreSQL lags MySQL significantly [1] in features; maybe that is related.

[1] https://github.com/pauldraper/aws-aurora-sql

Re:Dynamo vs. Cassandra: Systems Design of NoSQL Databases (... by antman on Saturday December 14, 2019 @12:42PM (#21790777)
I remember in another thread here on HN an engineer chimed in and said it is Cassandrs.
Re:Dynamo vs. Cassandra: Systems Design of NoSQL Databases (... by redwood on Saturday December 14, 2019 @12:41PM (#21790769)
DynamoDB under the hood
Re:Dynamo vs. Cassandra: Systems Design of NoSQL Databases (... by tnolet on Saturday December 14, 2019 @02:08PM (#21791422)
Citation needed...
Re:Dynamo vs. Cassandra: Systems Design of NoSQL Databases (... by mmbleh on Saturday December 14, 2019 @02:32PM (#21791609)
Re:Dynamo vs. Cassandra: Systems Design of NoSQL Databases (... by tnolet on Sunday December 15, 2019 @01:31PM (#21797896)
The tweet literally says “it’s Apache Cassandra under the hood”. Then it says the reused some tech from DynamoDB which can mean anything.
Re:Dynamo vs. Cassandra: Systems Design of NoSQL Databases (... by scarface74 on Saturday December 14, 2019 @02:42PM (#21791667)
It seems just like Aurora then. The code is MySql/Aurora with AWS’s own storage layer.
Re:Dynamo vs. Cassandra: Systems Design of NoSQL Databases (... by alexnewman on Saturday December 14, 2019 @10:43AM (#21790025)
Yearly reminder dynamo != dymanodb
Re:Dynamo vs. Cassandra: Systems Design of NoSQL Databases (... by snypox on Saturday December 14, 2019 @03:16PM (#21791899)
Hmm, looks like Dynamo is a storage system. Interesting, never heard about it before.

https://en.wikipedia.org/wiki/Dynamo_(storage_system)

Re:Dynamo vs. Cassandra: Systems Design of NoSQL Databases (... by snak on Monday December 16, 2019 @11:38AM (#21804315)
Thanks for the reminder. Should be mentioned in the article.
Re:Dynamo vs. Cassandra: Systems Design of NoSQL Databases (... by ripvanwinkle on Saturday December 14, 2019 @12:45PM (#21790802)
In the last write wins mechanism if two writes (V1 and V2) happen concurrently to different replicas why is V2 considered the last write in the article.

Reading the explanation and lead up, i was left with the impression that the last updates to each column (for a columnar store like Cassandra) would take effect so the final would be

{"street" : "Cubbon", "city" : "Bombay"}

Re:Dynamo vs. Cassandra: Systems Design of NoSQL Databases (... by FpUser on Saturday December 14, 2019 @02:31PM (#21791599)
Is it just me having inadequate vision or the visual design of the article is challenging? Light grey text on white background, dark red and blackish colors on dark grey background.