News for hackers. Stuff that matters.

A comment on Presto: Interacting with petabytes of data at Facebook. Parent comment

Re:Presto: Interacting with petabytes of data at Facebook by cjg_ on Thursday November 07, 2013 @12:13PM (#6690605)
Where do you get the limit of 256TB compressed from?

     Amazon Redshift enables you to start with as little 
     as a single 2TB XL node and scale up all the way to
     a hundred 16TB 8XL nodes for 1.6PB of compressed user data.
from http://aws.amazon.com/redshift/features-and-benefits/
[ Parent | on HN ]
Re:Presto: Interacting with petabytes of data at Facebook by spikels on Thursday November 07, 2013 @04:53PM (#6692677)
My mistake, thank for the correction.

The 16 node limit I was familiar with is not a hard limit. You can request more nodes.

http://aws.amazon.com/redshift/faqs/#0080

It would be interesting to see performance comparisons on these huge datasets. I would expect to see new and interesting problems at that scale.

[ Parent | on HN ]