News for hackers. Stuff that matters.
Re:Ask HN: How do I improve our data infrastructure? by aarbor989 on Sunday April 21, 2019 @12:56PM (#19713054)
We had Redshift for our 23TB+ dataset and it worked great. The downside is it can get pricy, so do a cost analysis before you commit. Also know that views in redshift are not materialized so it’s more efficient to create physical tables of the views - which then adds maintenance overhead. The last thing I’ll add is that you’ll need to experiment with compression settings for your data. For us, a combination of ZSTD and bytedict was all we needed

There are no comments on this comment yet.