Re:Cloudera announces real-time query engine for Hadoop
by TallGuyShort on Wednesday October 24, 2012 @10:52AM
(#4693165)
This doesn't change Hadoop from batch processing to real time - it's a new query engine that uses the same data sources/formats as Hadoop and the same interfaces as Hive. So yeah, similar idea to Google Dremel / F1.
[ Parent
| on HN ]
Re:Cloudera announces real-time query engine for Hadoop
by ryanpers on Wednesday October 24, 2012 @12:38PM
(#4693693)
It isn't like F1 at all... F1 is a multi-datacenter, transactional datastore and SQL, that google uses to replace mysql.
This aint nothing like that.
Re:Cloudera announces real-time query engine for Hadoop
by monstrado on Wednesday October 24, 2012 @11:16AM
(#4693282)
You're right that the data is still stored in HDFS, and you can access the data that was originally accessed in Hive. However, because of the way Impala works, it does in fact provide a real-time query interface for data that is sitting in Hadoop (HDFS). The back-end is written in C++ and accesses/processes data much differently than MapReduce which allows for some pretty awesome performance numbers :-)