Re:Ask HN: Any ideas on how to thumbnail 2M images?
by Igglyboo on Friday September 05, 2014 @04:29PM
(#8276116)
I'd assume that the bottle neck would be I/O if these images are ~30mb as the OP stated in the thread. I don't think you'd see 4x speedups from parallelizing.
Re:Ask HN: Any ideas on how to thumbnail 2M images?
by orr94 on Friday September 05, 2014 @04:30PM
(#8276129)
Good point. All the more reason to actually measure and find the bottleneck.
I suggest actually timing some of this stuff before writing off the idea. If an image can be processed in 1 second, and you can parallelize it to 4 cores, some quick and dirty (and probably useless) math says 2 million images could be done in just under 6 days. I don't think that's too shabby for 2 million images.