News for hackers. Stuff that matters.
Re:U.S. To Build Two Flagship Supercomputers for National Labs by epistasis on Friday November 14, 2014 @04:39PM (#8609650)
>The general reason comes down to inter-node bandwidth

And sometimes even more than bandwidth, inter-node latency, which is where Inifinband really shines over ethernet. Calculations which have high levels of node-to-node dependencies are pretty much the difference between super computers and the type of stuff that large internet companies compute on.

I hear (but don't personally know) that Google-style large data center installs are moving towards the CLOS-style networks that have been popular in HPC for a long time. These network topologies give equal bandwidth between any pair of nodes, as well as nearly equal latency.

Re:U.S. To Build Two Flagship Supercomputers for National Labs by mscman on Friday November 14, 2014 @05:29PM (#8609900)
Not just Google. Amazon's "Enhanced networking" uses a feature in 10GbE that's been used in smaller HPC clusters for around 5-10 years now. And MS Azure has InfiniBand backing their highest-tier instance types.

Many datacenters are adopting HPC technologies to reach the scale they need.