Re:Nvidia DGX GH200: The First 100 Terabyte GPU Memory System
by jandrese on Wednesday May 31, 2023 @12:53PM
(#36140544)
I have to wonder how much improvement you would get with a 100 trillion parameter model. There seems to be diminishing returns in model size. That effort could almost certainly be better spent.
[ Parent
| on HN ]
There are no comments on this comment yet.