If the people in charge of this thing had an epiphany (or a blackout, take your pick) and left you with the keys for a year, what could you do with this inefficient but impressively large cluster, besides anchoring your paperwork?
the scientific codes which parallelize poorly often parallelize poorly because they are written in ancient languages with support for whatever supercomputer interconnect bolted on poorly, Whereas TPU's + JAX have beautiful functional abstractions for distributed tensor computations.
Just funding re-writes of all the basic math/physics stack into a language with a PORTABLE parallel functional design and perhaps a compilation layer would definitely get more basic science done than this thing.
True.
> (at 1000x the cost)
Not as true. Summit, the previous machine, hit 148 petaflops (Rmax) at a cost of $325 million. Frontier has already hit 1102 petaflops (Rmax) at a cost of just under $600 million.
It's fun to have big toys sure, it's fun to make big GPU clusters. But if they spent what they spend on this computer, on just funding students to solve problems and toss them a 3090 100000000x more scientific breakthroughs would happen. This machine is 60% paperweight, at best, with a hefty budget for good old fashioned contract pork.