News for hackers. Stuff that matters.
Re:$99 Raspberry Pi-sized “supercomputer” touted in Kickstar... by josephlord on Friday September 28, 2012 @08:45PM (#4588457)
Yes there are infinitely* many problems that can be parallelised but even in the best case they will only equal the single processor at double the speed.

http://home.wlu.edu/~whaleyt/classes/parallel/topics/amdahl....

I should have referenced Amdahl's law in the previous post but didn't want to misspell it and bother to look it up.

*Infinite numbers exist of both parallel and serial computing requirements. Practically there will almost always be additional cost in parallel implementation even if the extra is insignificant such as higher start up cost and coordination for shutdown.

Re:$99 Raspberry Pi-sized “supercomputer” touted in Kickstar... by mclarkk on Wednesday October 03, 2012 @08:07PM (#4610267)
Amdahl's Law did throw a damp cloth over the fire of enthusiasm about parallel computing...for a while. But then we got Gustafson's Law:

http://en.wikipedia.org/wiki/Gustafson%27s_Law

Gustafson and Barsis pointed out that Amdahl assumed a fixed input size. If instead you grow the problem size along with the number of processors, the speedup from parallelism grows indefinitely. Of course, like Amdahl, they assume perfect load balancing and don't factor in communication overhead. But parallel still beats the pants off of serial if we want to keep solving larger and larger problems.