Cloudera announces real-time query engine for Hadoop

Re:Cloudera announces real-time query engine for Hadoop by jgrahamc on Wednesday October 24, 2012 @11:04AM (#4693221)

This looks very interesting. I've got multiple PB of log files that I'd like to be able to do real-time and batch processing on. Log files are being generated at a small number of Gbps.

Anyone else got that much data and have a good solution?

[ Parent | on HN ]

Re:Cloudera announces real-time query engine for Hadoop by untitledwiz on Wednesday October 24, 2012 @11:35AM (#4693375)

I don't think anyone has managed to get interactive speeds (~seconds to max couple of minutes) at the PB scale.

[ Parent | on HN ]

Re:Cloudera announces real-time query engine for Hadoop by benbjohnson on Wednesday October 24, 2012 @11:48AM (#4693440)

What kind of analysis are you trying to do on that dataset? Log files can be verbose as well. Do you need all the data in the logs or can you cut down the data in each row to only what you need?

[ Parent | on HN ]