Re:Reducing the Computational Cost of Deep Reinforcement Lea...
by visarga on Tuesday July 13, 2021 @05:59PM
(#27826802)
> Can Language Models Be Too Big?
That's interesting, GPT-n with 100T parameters would be bored by just reading the whole internet. Too little information, repetitive and on average, junk.
You can try the question in reverse too: Can evolution use too much energy? How much energy has it already consumed?
That's interesting, GPT-n with 100T parameters would be bored by just reading the whole internet. Too little information, repetitive and on average, junk.
You can try the question in reverse too: Can evolution use too much energy? How much energy has it already consumed?