News for hackers. Stuff that matters.
Re:Google Open-Sources Trillion-Parameter AI Language Model ... by swirepe on Wednesday February 17, 2021 @07:33PM (#26173890)
(They are definitely going to exceed their storage quotas.)

I want to see how well weights for these models compress, but it will take me some time to run this code and generate some. I'm guessing they won't compress well, but I can't articulate a reason why.

Re:Google Open-Sources Trillion-Parameter AI Language Model ... by wisty on Wednesday February 17, 2021 @07:45PM (#26173975)
If weights compress, they have low information, which would suggest they're either useless or the architecture is bad.