Re:Ask HN: Recommend tools to manipulate massive (5 million ...
by akg_67 on Friday April 04, 2014 @12:06AM
(#7529221)
You may want to consider using R (RHIPE for large datasets - R with Hadoop MapReduce) for analysis and visualization. R/RHIPE can easily handle 5 million observations. I have used RHIPE with 500GB dataset. I am currently trying to setup a multi-node RHIPE cluster to handle larger datasets for my personal project.
You may be able to use Tableau Public, but your dataset may exceed the storage limits on Public free account.
Another option may be to use Hadoop-as-a-Service (no visualization) such as Quoble or TreasureData. I recently tried out TreasureData, a decent service if your data has timestamps. You can run HIVE queries to filter and narrow your data and then export out results to use in Visualization softwares.
You may be able to use Tableau Public, but your dataset may exceed the storage limits on Public free account.
Another option may be to use Hadoop-as-a-Service (no visualization) such as Quoble or TreasureData. I recently tried out TreasureData, a decent service if your data has timestamps. You can run HIVE queries to filter and narrow your data and then export out results to use in Visualization softwares.