News for hackers. Stuff that matters.

A comment on Don't use Hadoop when your data isn't that big (2013). Parent comment

Re:Don't use Hadoop when your data isn't that big (2013) by _dark_matter_ on Tuesday May 23, 2017 @11:30AM (#14402061)
Spark is not pure MR. Spark has Spark Dataframes and Datasets with SQL-like syntax. You can even write pure SQL and not mess with the Dataframe API at all.

Presto is nice, but you can't use it for an ETL job. It is great for analysis.

[ Parent | on HN ]
Re:Don't use Hadoop when your data isn't that big (2013) by electrum on Wednesday May 24, 2017 @01:33AM (#14407803)
Presto works great for ETL. It supports CREATE TABLE, INSERT and DELETE for Hive data. Many companies use it for ETL. See examples here:

https://prestodb.io/docs/current/connector/hive.html#example...

[ Parent | on HN ]