News for hackers. Stuff that matters.

A comment on Don't use Hadoop when your data isn't that big (2013). Parent comment

Re:Don't use Hadoop when your data isn't that big (2013) by threeseed on Tuesday May 23, 2017 @02:46PM (#14404012)
Spark SQL is actually ANSI SQL.

Plus you can mix and match R, Scala and SQL all together.

[ Parent | on HN ]
Re:Don't use Hadoop when your data isn't that big (2013) by dswalter on Tuesday May 23, 2017 @07:19PM (#14406309)
I used to use Spark SQL for this purpose, but I've switched. I now use Spark for when I want to transform data. But when I'm writing ad-hoc data exploration/investigation queries, PrestoDB is my jam; it's what it's designed for. Parquet as the data storage method makes both of these quite workable.
[ Parent | on HN ]