ion precedes PartiQL by many years, maybe even a decade. The sole reason ion exists is to make parsing json faster and less ambiguous so that a few specific edge cases are handled efficiently. So far so good, right?

The problem is that it spreads, like an infection, to surrounding services. Inside Amazon there are literally hundreds of libraries that duplicate standard json libraries in various languages but support ion instead of json. All of this is just to deal with interoperability.

Ion is slower than protobufs and less universally understood than json. Honestly it's just an annoyance.

Yeah It’s more like a spec, they expect you to write the query optimizer, analyzer basically a new query engine. They offered a document based “reference” implementation on Kotlin though so I think expert could follow it.

Point is AWS might not make up its mind yet on whether this does more harm to their DB business or not

Ahh. I guess for SQL you could just pass the queries through, and for NoSQL engines try to convert the AST format.

When I was researching this area, it seems like Apache Calcite is the way to go, and already does this though?

It lets you use standard SQL and has adapters which translate from the abstract query AST to the particular implementation.

https://calcite.apache.org/docs/adapter.html

You can query anything with this, exactly the same way. It's kind of wild I've never heard it talked about tbh.

I went looking for solutions to multi-datastore querying when I fiddled with a business intelligence side project. Pretty useless to only be able to query one type of data, and too time consuming to implement individual mappings.

Apache Calcite and Metabase Query Language (quite the exact usecase there for Metabase, haha) were the only things I could find.

Given Postgres already supports document types, do you know what is the main advantage of using AWS' instead?

Does Postgres support column-oriented formats, like Parquet?

> Does Postgres support column-oriented formats, like Parquet?

With an appropriate FDW, sure, and I'm pretty sure I've seen an FDW for parquet specifically, as well as other columnar formats.

To give Amazon more money.

Oh you mean advantage to you? haha...well..

That sounds great, but is Kotlin really the only current implementation?

If you want a working implementation (see comment below) and not a reference for the parser, you could use Apache Calcite:

https://calcite.apache.org/

But again, yeah it's a JVM thing so your options are that.

It amazes how everyone likes to hate on JVM and yet nearly every enterprise company uses it in the big data space....

Everyone likes to hate on COBOL, and plenty of enterprises use it in all kinds of spaces, too.

The communication gap between Businesses using COBOL and Academic institutions teaching IT is the reason for the hatred for the language among young computer graduates. Whether you love or not you live with and support your family, so teach the youngsters to love COBOL, for their grandmother is not going to die any sooner!