Re:From a Frat Social Network to a GPU Compiler for Hadoop
by tonydiv on Tuesday November 19, 2013 @04:38PM
(#6764680)
We used parallel Python to implement the first version of the clustering algorithm. Although the CPUs weren't particularly beefy, the implementation was by no means poor. It's worth mentioning that the laptop GPU wasn't powerful either.
[ Parent
| on HN ]
Re:From a Frat Social Network to a GPU Compiler for Hadoop
by sanskritabelt on Tuesday November 19, 2013 @05:37PM
(#6765010)
In that case, how much of your 18000x speedup is due to the GPU and how much of it is due to re-implementing the algorithm in a compiled language? Python->C/C++/etc is a 100x-1000x speedup right off the bat.
That's not a fair CPU/GPU comparison at all.
Re:From a Frat Social Network to a GPU Compiler for Hadoop
by tonydiv on Tuesday November 19, 2013 @05:50PM
(#6765069)
You're right, it isn't a perfectly fair comparison. However, even if we had coded it in C++, the run time difference would still have been significant.
We're just sharing our story at this point. Next, we'll be sharing our whitepaper and data. We rather start gathering feedback now, as opposed to after writing 100k LoC for the compiler.