Re:Google Open-Sources Trillion-Parameter AI Language Model ...
by swirepe on Wednesday February 17, 2021 @07:33PM
(#26173890)
(They are definitely going to exceed their storage quotas.)
I want to see how well weights for these models compress, but it will take me some time to run this code and generate some. I'm guessing they won't compress well, but I can't articulate a reason why.
I want to see how well weights for these models compress, but it will take me some time to run this code and generate some. I'm guessing they won't compress well, but I can't articulate a reason why.