News for hackers. Stuff that matters.

A comment on Nvidia will build 700-petaflop supercomputer for University of Florida. Parent comment

Re:Nvidia will build 700-petaflop supercomputer for Universi... by anonymousDan on Friday July 24, 2020 @05:04AM (#23937340)
Is this really true? At least for inference I've seen data showing the trend is rather for smaller models that exploit sparsity.
[ Parent | on HN ]
Re:Nvidia will build 700-petaflop supercomputer for Universi... by pama on Friday July 24, 2020 @10:07AM (#23939667)
This is a chart from before GPT-3: https://www.microsoft.com/en-us/research/blog/turing-nlg-a-1...
[ Parent | on HN ]
Re:Nvidia will build 700-petaflop supercomputer for Universi... by nl on Friday July 24, 2020 @10:09AM (#23939693)
Yes, in NLP big models rule and they are getting bigger.
[ Parent | on HN ]