News for hackers. Stuff that matters.

flyovercountry

Re:Presto: Interacting with petabytes of data at Facebook on Wednesday November 06, 2013 @10:53PM (#6687395)
The file format for hadoop tools is a sequence file. For most queries this is the second slowest format, after text.

Rcfile or parquet would be a more interesting benchmark.

Re:Presto: Interacting with petabytes of data at Facebook on Wednesday November 06, 2013 @10:01PM (#6687187)
HDFS now supports placement groups with one use case being columnar storage.