News for hackers. Stuff that matters.

A comment on Ask HN: How to handle 50GB of transaction data each day? (200GB during peak). Parent comment

Re:Ask HN: How to handle 50GB of transaction data each day? ... by late2part on Wednesday February 24, 2016 @09:13PM (#11171921)
Here here ; +1.

Kafka = good. Postgres can do a TB; if you plan bigger than that consider Cassandra.

Also consider protobuf instead of json.gz.

[ Parent | on HN ]
Re:Ask HN: How to handle 50GB of transaction data each day? ... by stuartaxelowen on Wednesday February 24, 2016 @10:39PM (#11172221)
Or... Arrow?! :O

JK it's too early :(

[ Parent | on HN ]