News for hackers. Stuff that matters.
Re:EU Grabs ARM for First ExaFLOP Supercomputer, x86 Misses Out by pclmulqdq on Friday October 06, 2023 @01:36PM (#37793642)
Almost all of the AI computers being built now are relatively modestly sized compared to a supercomputer. All but the biggest ones are at or under the low hundreds of nodes (low thousands of GPUs). The only real exceptions are the few AI hyperscale companies that want to sell GPU computing to others.
Re:EU Grabs ARM for First ExaFLOP Supercomputer, x86 Misses Out by bee_rider on Friday October 06, 2023 @02:17PM (#37794206)
Do AI hyperscalers devote a their whole system to one big run anyway?

If they don’t, then those are big clusters in the sense that AWS is the world’s biggest supercomputer, which is to say, not.

Re:EU Grabs ARM for First ExaFLOP Supercomputer, x86 Misses Out by pclmulqdq on Friday October 06, 2023 @05:11PM (#37796473)
AWS is not a supercomputer because it doesn't have high-adjacency networking. If AWS turned its biggest region loose on Linpack, I would be surprised if they cracked the top 50 on the supercomputer list, despite probably having more cores than #1.

The AI hyperscalers certainly claim to be able to devote 100% of cluster capacity to one training run. Google is training some huge models, OpenAI is also.