Show HN: Querying JSON documents using SQL-like language in Scala

Re:Show HN: Querying JSON documents using SQL-like language ... by anon176 on Tuesday February 25, 2020 @04:12PM (#22417511)

Pretty cool. You can do this in apache spark already but this looks a lot quicker to get going with.

[ Parent | on HN ]

Re:Show HN: Querying JSON documents using SQL-like language ... by mmalek06 on Tuesday February 25, 2020 @04:18PM (#22417554)

Didn’t know about it. Is it possible to use only that subset of apache spark lib?

[ Parent | on HN ]

Re:Show HN: Querying JSON documents using SQL-like language ... by EdwardDiego on Tuesday February 25, 2020 @07:13PM (#22418985)

I imagine you could reuse Catalyst to generate queries against JSON derived Datasets with some work. Starting point for some reading maybe? https://github.com/apache/spark/blob/e2d3983de78f5c80fac066b...

[ Parent | on HN ]

Re:Show HN: Querying JSON documents using SQL-like language ... by yami-sama on Tuesday February 25, 2020 @09:25PM (#22419713)

If you need to parse semi-structured documents using Spark, Quenya-DSL is much better than SQL, specially if you want to flatten the data.

https://github.com/music-of-the-ainur/quenya-dsl

[ Parent | on HN ]

Re:Show HN: Querying JSON documents using SQL-like language ... by anon176 on Tuesday February 25, 2020 @05:25PM (#22418158)

Yes, you can run apache spark as a single node really easily. Then once its running you can fire up the Scala or Python shell that it comes with. After that, it is just a matter of issuing the statements to setup the data set then issues queries against it.

[ Parent | on HN ]

Re:Show HN: Querying JSON documents using SQL-like language ... by khc on Tuesday February 25, 2020 @11:47PM (#22420352)

Not many people know this but Databricks offers https://community.cloud.databricks.com/ for free which allows you to run simple spark notebooks.

Disclosure: works for Databricks but not on spark

[ Parent | on HN ]

Re:Show HN: Querying JSON documents using SQL-like language ... by mmalek06 on Wednesday February 26, 2020 @05:01AM (#22421745)

Still, it seems like a lot of work. My case was that I just wanted to feed JSON document into some mechanism that will give me back what I want. I wouldn't like to embed whole Spark framework into my app. I will read about it though :)

[ Parent | on HN ]