Command-line tools can be faster than a Hadoop cluster (2014)

Re:Command-line tools can be faster than a Hadoop cluster (2... by threeseed on Thursday January 30, 2020 @02:44AM (#22189655)

Not sure where you are getting your costs from.

Threadripper 3970x = 32 cores @ $1999

AWS c5.9xlarge = 36 vCPUs @ $8.34/day (spot)

You could buy a year of AWS for the same price as a Threadripper based PC.

[ Parent | on HN ]

Re:Command-line tools can be faster than a Hadoop cluster (2... by fxtentacle on Thursday January 30, 2020 @02:57AM (#22189700)

I was comparing with ChaosCloud: https://www.chaosgroup.com/cloud

For EC2, one would need to rent licenses for the V-Ray renderer plus V-Ray tends to be heavily CPU-cache- and memory-bound, so exactly the parts that get slow if you enable the Intel security fixes. Due to c5.9xlarge being Xeons, they are like 80% slower than a comparable AMD CPU.

BTW, calculator.s3.amazonaws.com quotes me $1119 per month for a single c5.9xlarge, so I'm not sure how you would reach $8/day when I see $37/day.

[ Parent | on HN ]

Re:Command-line tools can be faster than a Hadoop cluster (2... by threeseed on Thursday January 30, 2020 @03:06AM (#22189723)

Then switch to the AMD based c5a.9xlarge which is even cheaper.

And you can reach $8/day using Spot or Reserved Instances. Not sure where you get $1119.

[ Parent | on HN ]