News for hackers. Stuff that matters.
Re:What's faster - a supercomputer or EC2? by sophacles on Wednesday August 05, 2009 @11:00AM (#743540)
And... if you don't need lots of communication between nodes, I'd guess EC2 probably is the best way to go in terms of $/computation too.
Re:What's faster - a supercomputer or EC2? by tyvkiuiyi on Wednesday August 05, 2009 @02:06PM (#743903)
Depends on utilisation. If you own a cluster and are able to keep it busy 24x7 then it pays off pretty quickly. Amazon have to have enough spare idle capacity to handle unexpected customer loads and make a profit - you are paying for this.
Re:What's faster - a supercomputer or EC2? by sophacles on Wednesday August 05, 2009 @02:57PM (#744005)
Good point. I wonder at what % utilization a cluster beats EC2 in terms of $/computation. Actually I'm sure there are all sorts of variables, and it becomes an optimization problem, but I think it would be cool to see an analysis of this in terms of $, computation power (time/jobsize or something), etc.
Re:What's faster - a supercomputer or EC2? by tyvkiuiyi on Wednesday August 05, 2009 @04:20PM (#744167)
Custer scheduling is a huge area. I used to work on MPI clusters and it is an art to balance CPU, Bandwidth, propagation time to pick the optimum number of processors for a particular algorithm.

Especially on commodity ethernet based MPI, it doesn't do broadcast so shipping a Gb common dataset to 64nodes can take a lot longer than actualy doing the calculation.

Re:What's faster - a supercomputer or EC2? by sophacles on Wednesday August 05, 2009 @04:36PM (#744202)
Strange -- I always just sort of assumed that since they are making big clusters, they could spend the extra $$ for a good multicast switch, and that MPI did ip multicast. (a quick googling shows me to be wrong...).
Re:What's faster - a supercomputer or EC2? by jacquesm on Thursday August 06, 2009 @04:32AM (#745038)
I'm pretty sure a lot of people would donate for a statue in your likeness if you solved that.
Re:What's faster - a supercomputer or EC2? by easp on Thursday August 06, 2009 @10:13PM (#746870)
My understanding was that a lot of research clusers actually have pretty low utilization. I believe the cloud computing whitepaper David Patterson put out in the spring had I data on that.