Re:Scott Aaronson, when reached for comment, said
by dekhn on Wednesday November 17, 2021 @10:35AM
(#29254443)
A full DGX pod, like full TPU pod is a "ML supercomputer". The big detail being that they don't typically support all CPU functionality, and tend to have support only for smaller datatypes (float instead of double). However, neither can act as a full replacement for current HPC codes, although that is a very exciting area of research.
But with some problems we're seeing that we can solve them with petabyte scale lookup tables. Is that a super computer?
I'd really like to hear if there even is a coherent definition anymore or if that line is just blurred forever.