News for hackers. Stuff that matters.
Re:Amazon’s consumer business has turned off its Oracle data... by Derek_MK on Friday November 09, 2018 @07:18PM (#18419125)
There are places where relational DBs are inherently better than noSQL (namely when you need fully up-to-date information on every query, no matter what) - But those situations are becoming more rare compared to situations where potentially stale data is an okay tradeoff for performance gains.

Honestly, IMO the biggest issue holding noSQL databases back is lack of good documentation/support a lot of the time. Technically, though, they're going to become the standard for most use cases soon.

Re:Amazon’s consumer business has turned off its Oracle data... by threeseed on Saturday November 10, 2018 @02:08AM (#18420305)
Why do people continue to use the term NoSQL ? It's ridiculous.

There are hundreds maybe thousands of NoSQL databases ranging from Redis to MongoDB to Cassandra to InfluxDB to Druid. They pretty much have nothing in common other than storing data. Many of them support SQL directly, others via Spark and almost all have a SQL equivalent.

Re:Amazon’s consumer business has turned off its Oracle data... by endymi0n on Saturday November 10, 2018 @07:22AM (#18421049)
Exactly this, „non-traditional“ and noSQL is as inexact as it gets. It includes an incredibly wide range of architectures, from Spanner and CockroachDB which deliver ACID guarantees equal and even surpassing relational systems to pure performance tuned systems such as Aerospike which have few guarantees and features but are blazingly fast. There are pretty much all shades of consistency in between, like Cassandra and Scylla with tunable consistency amd LWT. Lumping them all together into a single category will yield poor results.
Re:Amazon’s consumer business has turned off its Oracle data... by jefftk on Friday November 09, 2018 @10:36PM (#18419787)
> when you need fully up-to-date information on every query, no matter what

This doesn't require something relational, just something centralized. And not even that; consider Spanner.

Re:Amazon’s consumer business has turned off its Oracle data... by just_myles on Friday November 09, 2018 @07:52PM (#18419257)
Agreed. I think for temporal data (accounting) reporting non-relational databases are fine.
Re:Amazon’s consumer business has turned off its Oracle data... by just_myles on Tuesday November 13, 2018 @06:40PM (#18445940)
To clarify further. Of course, you will need a relational data repository.
Re:Amazon’s consumer business has turned off its Oracle data... by lykr0n on Friday November 09, 2018 @07:42PM (#18419216)
The problem with noSQL is that there are too many players out there making duplicated efforts. You have MySQL & MariaDB and PostgreSQL as the two main SQL platforms, but you have too may to list in the noSQL field- most of them providing the same amount of functionality.
Re:Amazon’s consumer business has turned off its Oracle data... by blihp on Friday November 09, 2018 @08:00PM (#18419297)
This always happens and the noSQL market will eventually consolidate / settle down to a handful of players just as the SQL market did.
Re:Amazon’s consumer business has turned off its Oracle data... by DaiPlusPlus on Friday November 09, 2018 @09:34PM (#18419610)
That depends on the functionality requirements of noSQL customers. I posit that writing a new, indepedent RDBMS that implements the latest SQL spec with the same maganement and replication capabilities as the incumbents is on-par with trying to compete with WebKit and Gecko. The SQL Server engineering team at Microsoft is about 1,000 people according to my friends on campus.

Whereas implementing a Key-Value Store is orders of magnitude simpler. There is plenty of room for innovation, of course - but you don’t need 1,000 people to build-on some new replication scheme or distributed backend.

If you take a simple NoSQL system then tack on things like object scheme support, JSON blob value indexes, node graph support, etc you’ll end up with an RDBMS analogue.

So the barrier-to-entry to building a NoSQL system is much lower than a RDBMS - and for many companies they might decide to build their own rather than extend an existing system - leading to more completion but not necessarily a better product.

Re:Amazon’s consumer business has turned off its Oracle data... by blihp on Friday November 09, 2018 @09:52PM (#18419656)
It always starts that way. In time, the legacy baggage that gets added will turn the noSQL databases into the same bloated monsters that the SQL databases have become. There was a time when many of the SQL database options were the (relatively) simpler and more powerful options vs the wide variety of home-grown databases they eventually replaced. (i.e. there was a lot of baked in business logic etc. that the move to SQL databases forced companies to disentangle from the database engine itself) SQL Server was originally just a fork of Sybase SQL Server (a much smaller, simpler version) with some FoxPro tech bolted on to it...
Re:Amazon’s consumer business has turned off its Oracle data... by natmaka on Saturday November 10, 2018 @10:20AM (#18421635)
A famous P. Greenspun quote may be savagely hacked for the topic at hand: Any sufficiently complicated No/New/WhateverSQL engine contains an ad hoc, informally-specified, bug-ridden, slow implementation of a RDBMS.
Re:Amazon’s consumer business has turned off its Oracle data... by DaiPlusPlus on Friday November 09, 2018 @10:29PM (#18419763)
Right - and FoxPro was just another dBase clone. NoSQL today is where dBase was 30 years ago.
Re:Amazon’s consumer business has turned off its Oracle data... by sjellis on Saturday November 10, 2018 @03:06AM (#18420425)
> That depends on the functionality requirements of noSQL customers. I posit that writing a new, indepedent RDBMS that implements the latest SQL spec with the same maganement and replication capabilities as the incumbents is on-par with trying to compete with WebKit and Gecko. The SQL Server engineering team at Microsoft is about 1,000 people according to my friends on campus.

CockroachDB is the newest from-scratch SQL engine that I am aware of: https://www.cockroachlabs.com/

They re-use the RocksDB K/V store maintained by Facebook (in C++) as the storage layer, and their own code is written in Go, so I suspect that their development work is probably a lot less time-expensive than the teams working on older SQL databases.

Re:Amazon’s consumer business has turned off its Oracle data... by scarface74 on Friday November 09, 2018 @09:03PM (#18419528)
Are you forgetting about SQL Server and Oracle?
Re:Amazon’s consumer business has turned off its Oracle data... by icebraining on Friday November 09, 2018 @10:23PM (#18419746)
And SQLite!
Re:Amazon’s consumer business has turned off its Oracle data... by AznHisoka on Friday November 09, 2018 @10:36PM (#18419786)
and Sybase and ComDB...
Re:Amazon’s consumer business has turned off its Oracle data... by Spooky23 on Friday November 09, 2018 @09:42PM (#18419632)
That’s what happens in a growing market. Once it’s matured, it boils down to a handful.
Re:Amazon’s consumer business has turned off its Oracle data... by hodgesrm on Friday November 09, 2018 @11:09PM (#18419889)
> You have MySQL & MariaDB and PostgreSQL as the two main SQL platforms

Based on license revenue it's actually Oracle and MS SQL server by miles. They are currently #1 and #3 on DB-Engines.com. (https://db-engines.com/en/ranking) MySQL is #2. PostgreSQL is #4, though it's pretty far back from the first three.

Re:Amazon’s consumer business has turned off its Oracle data... by marcolussetti on Friday November 09, 2018 @11:40PM (#18419979)
Maybe I'm confused, but ranking databases on license revenue will inevitably show that the databases that charge licenses are higher.

I mean PostgreSQL is open source, and required no license fee. I'm not sure that license revenue is a good comparison metric.

Re:Amazon’s consumer business has turned off its Oracle data... by hodgesrm on Sunday November 11, 2018 @09:04PM (#18430070)
DBMS Engines uses a set of metrics that does not include revenue. See https://db-engines.com/en/ranking_definition for more. Oracle and MS SQL Server have consistently ranked highly there for many years.
Re:Amazon’s consumer business has turned off its Oracle data... by killbrad on Friday November 09, 2018 @11:41PM (#18419984)
You know MySQL, MariaDB, and Postgres don't have licensing costs, right?
Re:Amazon’s consumer business has turned off its Oracle data... by hodgesrm on Sunday November 11, 2018 @09:01PM (#18430056)
Of course. I've worked in and around the OSS DBMS market for over a decade. But the numbers were really big. It seems to me that out of a 2015 US $30B DBMS market Oracle and MS were collecting something like US $29B. The rest of the market,which included products like MongoDB and Cassandra was close to a rounding error. (I don't have the Gartner report handy, sorry.)

It's popular on HN to focus on OSS products, but there's a very large proprietary RDBMS market measured both in terms of revenue as well as users. That's how Oracle and MS got to be the behemoths they are today.

Re:Amazon’s consumer business has turned off its Oracle data... by amf12 on Saturday November 10, 2018 @01:51AM (#18420266)
> namely when you need fully up-to-date information on every query, no matter what

So you basically want full consistency (vs eventual consistency) in a distributed environment. You can set up you noSQL that way. I don't see how relational DB's are "better" than noSQL in consistency.

Re:Amazon’s consumer business has turned off its Oracle data... by ric2b on Sunday November 11, 2018 @05:59PM (#18429268)
And if you do that you go back to the performance of one instance or (probably) worse.
Re:Amazon’s consumer business has turned off its Oracle data... by amf12 on Monday November 12, 2018 @02:56AM (#18431197)
Absolutely, but isn't that the case for SQL too? My point being, noSQL is not worse than SQL if all you care about is storing and retrieving documents vs joins, etc.