News for hackers. Stuff that matters.

A comment on Ask HN: What are some ways to work with large amounts of data quickly?.

Re:Ask HN: What are some ways to work with large amounts of ... by karterk on Monday June 06, 2016 @08:39AM (#11846294)
1. People don't store such large amounts of data in a conventional database (especially relational DB). Depending on the exact requirements, the popular choices are HBase, Cassadra or even flat files in HDFS.

2. To analyze the data, Hadoop and Spark are great. Spark is especially a great fit for iterative algorithms, and it also has a great python interface.

[ Parent | on HN ]

There are no comments on this comment yet.