Re:Reducing the Computational Cost of Deep Reinforcement Lea...
by visarga on Tuesday July 13, 2021 @05:59PM
(#27826802)
> Can Language Models Be Too Big?
That's interesting, GPT-n with 100T parameters would be bored by just reading the whole internet. Too little information, repetitive and on average, junk.
You can try the question in reverse too: Can evolution use too much energy? How much energy has it already consumed?
Re:Reducing the Computational Cost of Deep Reinforcement Lea...
by dna_polymerase on Wednesday July 14, 2021 @04:54AM
(#27831004)
Why would they fire someone over this piece of shit paper? Does anyone think Google is threatened by the idea of AI using energy?
Re:Reducing the Computational Cost of Deep Reinforcement Lea...
by pas on Wednesday July 14, 2021 @02:06AM
(#27830155)
It was not the paper that get her fired. (Probably there isn't just one ultimate cause that led to her firing, but maybe we can say that big G has a tendency to fire those who rock the boat too loudly.)
https://dl.acm.org/doi/10.1145/3442188.3445922
That would explain why such a mundane subject is in a blog post, it's focused at tech news to be all "we really do care about this thing" rather than academia.