News for hackers. Stuff that matters.
Re:Elasticsearch Was Never a Database by roywiggins on Friday January 16, 2026 @12:57PM (#46649509)
> Elastic has been working on this gap. The more recent ES|QL introduces a similar feature called lookup joins, and Elastic SQL provides a more familiar syntax (with no joins). But these are still bound by Lucene’s underlying index model. On top of that, developers now face a confusing sprawl of overlapping query syntaxes (currently: Query DSL, ES|QL, SQL, EQL, KQL), each suited to different use cases, and with different strengths and weaknesses.

I suppose we need a new rule, "Any sufficiently successful data store eventually sprouts at least one ad hoc, informally-specified, inconsistency-ridden, slow implementation of half of a relational database"

Re:Elasticsearch Was Never a Database by xeraa on Friday January 16, 2026 @02:21PM (#46650859)
Funny argument on the query languages in hindsight, since the latest release (https://www.paradedb.com/blog/paradedb-0-20-0 but that was after this blog) just completely changed the API. To be seen how many different API versions you get if you make it to 15 years ;)

PS: I've worked at Elastic for a long time, so it is fun to see the arguments for a young product.

Re:Elasticsearch Was Never a Database by esafak on Friday January 16, 2026 @02:18PM (#46650815)
Re:Elasticsearch Was Never a Database by wasting_time on Friday January 16, 2026 @04:07PM (#46652222)
ICYMI expands to "in case you missed it", ICYMI.
Re:Elasticsearch Was Never a Database by virgil_disgr4ce on Friday January 16, 2026 @04:20PM (#46652368)
ICYMI expands to ... wait, shit
Re:Elasticsearch Was Never a Database by patates on Saturday January 17, 2026 @05:05PM (#46662577)
I see... why am I...
Re:Elasticsearch Was Never a Database by kayo_20211030 on Friday January 16, 2026 @01:30PM (#46650025)
... and then becomes an email client (https://en.wikipedia.org/wiki/Jamie_Zawinski#Zawinski%27s_La...). A two-fer. lol.
Re:Elasticsearch Was Never a Database by all2 on Friday January 16, 2026 @04:12PM (#46652288)
It seems like everything converges on either LISP or emacs.
Re:Elasticsearch Was Never a Database by Joker_vD on Friday January 16, 2026 @08:37PM (#46654468)
Just as any "plain blob storage" eventually evolves a hierarchical filesystem (but with silly quirks!) on top of it.
Re:Elasticsearch Was Never a Database by deepsun on Saturday January 17, 2026 @02:27AM (#46656037)
AFAIK, in Google it was the other way around -- their main blob storage (BigTable) is built on top of GFS (distributed filesystem).
Re:Elasticsearch Was Never a Database by Scaevolus on Saturday January 17, 2026 @03:26AM (#46656269)
You have that backwards. GFS was replaced by Colossus ca. 2010, and largely functions as blob storage with append-only semantics for modification. BigTable is a KV store, and the row size limits (256MB) make it unsuitable for blob storage. GCS is built on top of Spanner (metadata, small files) and Colossus (bulk data storage).

But that's besides the point. When people say "RDBMS" or "filesystem" they mean the full suite of SQL queries and POSIX semantics-- neither of which you get with KV stores like BigTable or distributed storage like Colossus.

The simplest example of POSIX semantics that are rapidly discarded is the "fast folder move" operation. This is difficult to impossible to achieve when you have keys representing the full path of the file, and is generally easier to implement with hierarchical directory entries. However, many applications are absolutely fine with the semantics of "write entire file, read file, delete file", which enables huge simplifications and optimizations!

Re:Elasticsearch Was Never a Database by deepsun on Sunday January 18, 2026 @04:54AM (#46666378)
Thank you, yes my knowledge was very outdated, waay before Spanner.

Spanner for GCS actually explains how public Google Cloud was always ACID for object listing, while S3 only implemented it around 2020. I always suspected that there must be some very hard piece to implement that AWS didn't have until 2020. Makes sense now that that piece was Spanner.