News for hackers. Stuff that matters.

A comment on Crunch – Go-based toolkit for ETL and feature extraction on Hadoop.

Re:Crunch – Go-based toolkit for ETL and feature extraction ... by bsg75 on Wednesday November 19, 2014 @12:21PM (#8631260)
Is this useful for load targets other than Hadoop? RDBMS for example?
[ Parent | on HN ]
Re:Crunch – Go-based toolkit for ETL and feature extraction ... by jondot on Wednesday November 19, 2014 @12:26PM (#8631290)
Actually yes! Because I'm using Pig to "abstract" I/O you can use Pig to load data from anywhere (any format), it streams it into Crunch, and then again, Pig to save data to anywhere (any format).
[ Parent | on HN ]