News for hackers. Stuff that matters.
Re:China Tops U.S. in Supercomputers by bjd2385 on Monday June 20, 2016 @07:58AM (#11937405)
Please excuse my ignorance in this area, I was just wondering - why does it matter so much who has the biggest and baddest supercomputer? Shouldn't that which we process on them matter more?

A while back I recall reading rumors that China didn't even know what to process on their Tianhe-2. That kind of makes a supercomputer look like a pile of hardware, no matter how well it's organized or engraved.

Re:China Tops U.S. in Supercomputers by dibanez on Monday June 20, 2016 @08:03AM (#11937428)
Its essentially a matter of realistic benchmark acceptance. Right now machines are compared by how well they run this benchmark called LINPACK, which has been criticized for being non-representative of real science codes. As mentioned here [1], China's new system only achieved 0.3% of its peak flops on a slightly more realistic benchmark, HPCG.

[1] http://www.hpcwire.com/2016/06/19/china-125-petaflops-sunway...

Re:China Tops U.S. in Supercomputers by sanxiyn on Monday June 20, 2016 @08:17AM (#11937473)
While Sunway TaihuLight has weak HPCG performance, 0.3% number should be understood in context. Tianhe-2 (#2 system) scores 1.1%, and Titan (#3, US #1 system) scores 1.2% for HPCG. So Sunway TaihuLight is 3~4x worse for HPCG compared to other top systems.

Note that K computer (#5 system, Japan) scores 4.9% for HPCG. So Tianhe-2 and Titan are again 4x worse for HPCG compared to systems which score best for HPCG.

Re:China Tops U.S. in Supercomputers by bhouston on Monday June 20, 2016 @08:35AM (#11937540)
Why does the Sunway TaihuLight have bad HPCG performance? I suspect it has to do with memory bandwidth needed to serve 260C on the same chip?
Re:China Tops U.S. in Supercomputers by sanxiyn on Monday June 20, 2016 @08:59AM (#11937651)
Yes, it's memory and interconnect.

I don't think it's as simple as LINPACK bad, HPCG good. LINPACK is representative for some workloads, when compute dominates. HPCG aims to balance compute and memory. There is Graph500, if memory dominates for your workload.

By the way, K computer is #1 in Graph500.

Re:China Tops U.S. in Supercomputers by ams6110 on Monday June 20, 2016 @10:05AM (#11938087)
http://www.graph500.org/

The interconnect on the Sunway TaihuLight seems to be standard Infiniband, from reading other articles about the system.

Re:China Tops U.S. in Supercomputers by aab0 on Monday June 20, 2016 @02:57PM (#11940366)
I was wondering about third-party benchmarks. As far as I know, the Top500 is pure self-report, and this is a big national-prestige thing...
Re:China Tops U.S. in Supercomputers by ams6110 on Monday June 20, 2016 @09:55AM (#11938020)
You'd be surprised that people do buy supercomputers without a real idea (or only a rather vague general idea) of what they're going to do with it. And by people I mean universities. Not unheard of for a university to buy a supercomputer for essentially bragging rights, and then for it to sit underutilized.
Re:China Tops U.S. in Supercomputers by ghshephard on Monday June 20, 2016 @10:03AM (#11938074)
I would think that getting simulation time on a top ranked super computer would be something that you would schedule months, if not years in advance - hard to imagine that having access to a multi-petaflop wouldn't be highly desirable (and useful) for many, many researchers, let alone all the graduate students who spend months of lower-tier computers churning out simulations...

I'd be interested to hear from someone who knows/has experience, whether any of the top 100 super computers ever have idle windows.

Re:China Tops U.S. in Supercomputers by davidmr on Monday June 20, 2016 @11:13AM (#11938529)
I worked on a system that was at one time #3 on the list. There were no substantial idle periods. If the machine was out of maintenance, jobs were being run on it. Depending on the internal structure of the machine, some parts of it might be idle as the scheduler drained other parts to allow space for larger jobs to start, but I wouldn't call it idle.

Having done exclusively HPC for almost 16 years now, I can state that there is one and only one immutable law of HPC: grad students will find a way to squeeze out every second of available CPU time on a large system. The amount of effort going into taking advantage of those empty spots in the clusters where smaller jobs can run quickly while the scheduler drains resources for a large job (called backfilling) is tremendous.

The thing that sticks with me is what a fantastically complicated problem HPC job scheduling is. I've seen dozens of fresh-faced undergrads or first year grad students come in with a full head of steam and decide that they're going to "solve" HPC job scheduling, but every single one has gotten bogged down in the minutiae and the muck, and I've never seen software that "gets it right". Every scheduler sucks in its own unique way.

Whether all of those jobs need an old-fashioned supercomputer is certainly up for debate, but they certainly get used, at least in my experience.

Re:China Tops U.S. in Supercomputers by beamatronic on Monday June 20, 2016 @01:38PM (#11939615)
>> grad students will find a way to squeeze out every second of available CPU time on a large system

>> they certainly get used, at least in my experience

As a taxpayer, this made me feel good, thank you for sharing.

Re:China Tops U.S. in Supercomputers by wepple on Monday June 20, 2016 @01:32PM (#11939567)
interesting, do you feel that the lack of idle periods was because it was being used for tasks that truly demanded and could not be performed without that compute power?

Or was it a combination of that with "well its there, and we want to do this thing that would happen quicker on the big machine" - IE not necessarily enabling new research, just adding a nice speedup to existing work?

Re:China Tops U.S. in Supercomputers by tanderson92 on Monday June 20, 2016 @02:00PM (#11939820)
You don't generally build a large supercomputer to simply run a task faster than on a smaller cluster. The goal is to enable more realistic simulations by solving problems using a greater number of unknowns, increasing the fidelity of output.

So no, these machines are often used for problems which really do utilize the large-scale nature of the computers.

Re:China Tops U.S. in Supercomputers by davidmr on Monday June 20, 2016 @02:49PM (#11940277)
I agree with tanderson92. Whether the actual science from all the simulations is "worthwhile" is for people much smarter than me, but to get time on a "leadership" class machine, you have to prove in your application that a) it will run properly on the hardware; and b) that it's science you wouldn't get done on smaller machines.

So lots of the "big data" type problems with lots of uncoordinated jobs aren't going to take advantage of the primary component of these big computers, the node interconnect. The computers really shine with big fluid dynamics simulations where there's lots of chatter between different components of the simulation to communicate boundary conditions and the like.

Re:China Tops U.S. in Supercomputers by bluedino on Monday June 20, 2016 @08:27AM (#11937507)
>> rumors that China didn't even know what to process on their Tianhe-2.

Kind of reminds me of when we heard a rumor than a rival ISP had bought a handful of Sun servers (in the year 2000). We thought they had tends of thousands of customers, figured they would be launching DSL, figured that had thousands of web hosting customers...

Turns out they got some weird grant so they spent the cash on those, otherwise they would have lost the money. They went out of business a year later and we kept chugging along with our Pentium III servers.

Re:China Tops U.S. in Supercomputers by tluyben2 on Monday June 20, 2016 @10:52AM (#11938387)
This happened a lot with Sun around that time; I bought 10 E450s for fun from one of the hosters who did exactly that and since then went bankrupt. Great, unbreakable machines.
Re:China Tops U.S. in Supercomputers by ams6110 on Monday June 20, 2016 @12:43PM (#11939197)
Bubble dot-com companies rich with VC cash did the same thing. Built massively overprovisioned data centers with expensive Sun servers (because Sun == Internet at that time) and never actually had the traffic to justify even a fraction of it.
Re:China Tops U.S. in Supercomputers by bhouston on Monday June 20, 2016 @08:31AM (#11937520)
> A while back I recall reading rumors that China didn't even know what to process on their Tianhe-2. That kind of makes a supercomputer look like a pile of hardware, no matter how well it's organized or engraved.

There are enough high quality universites in China to make use of it. I can not imagine this is true. There may have not been one big algorithm that it was built for, but university researchers always have stuff to compute.

Re:China Tops U.S. in Supercomputers by iwontreddit on Monday June 20, 2016 @11:22AM (#11938585)
> A while back I recall reading rumors that China didn't even know what to process on their Tianhe-2.

That applies to most of supercomputers everywhere. "If you build it, they will come".

Besides the knowledge attained in building supercomputers ( which all major nations should know how to do ) and processor technology, the added benefits and new uses of these machines will come later.

The internet was created before people really knew what to do with it. The same thing with computers. The same thing with everything else.

Re:China Tops U.S. in Supercomputers by peter303 on Monday June 20, 2016 @04:53PM (#11941476)
US is routinely enbarassed by a more accurate European weather forecast computation. Hurricane Sandy prediction was the glaring example. Part of the Euro prowess is due to better physics. But much of it to a finer model they can compute in real time of a larger computer. Everytime you double the resolution, the computing cost increases 16 times in this 4D computation.
Re:China Tops U.S. in Supercomputers by angry_octet on Monday June 20, 2016 @07:33PM (#11942460)
You are implying that the accuracy is mainly due to greater compute. This is simply not true. If the US model could be improved by throwing money for compute at it, that would already have been done.

The following paper compares the EU and US ensembles: http://journals.ametsoc.org/doi/full/10.1175/MWR2905.1

Re:China Tops U.S. in Supercomputers by Zigurd on Monday June 20, 2016 @04:15PM (#11941145)
You would be correct to question if there is a first-order advantage to having the most powerful supercomputer. But it is a national strategic benchmark, like precision manufacturing, certain kinds of biotechnology, rocketry, etc.

What matters most might be that China is maturing CPU technology that isn't nearly as congenial for US TLAs to hack in to. It might not matter so much for this supercomputer, but if Chinese suppliers put price ahead of things like opaque management processors, it might lead to tipping the balance away from easily exploitable endpoints.

Re:China Tops U.S. in Supercomputers by ernestbro on Monday June 20, 2016 @09:33AM (#11937886)
Well for one there's being able to control 51% of bitcoin[1] which would let China "prevent transactions of their choosing from gaining any confirmations, thus making them invalid, potentially preventing people from sending Bitcoins between addresses. They could also reverse transactions they send during the time they are in control (allowing double spend transactions), and they could potentially prevent other miners from finding any blocks for a short period of time."

[1] https://learncryptography.com/cryptocurrency/51-attack

Re:China Tops U.S. in Supercomputers by Cthulhu_ on Monday June 20, 2016 @09:55AM (#11938023)
Some other comment I read about this calculated that this supercomputer has about 0.1% or 0.01% of an impact on the total bitcoin calculating power, so effectively negligible. ASICs would work better.
Re:China Tops U.S. in Supercomputers by jonbaer on Monday June 20, 2016 @09:31AM (#11937873)