News for hackers. Stuff that matters.
Re:Reducing the Computational Cost of Deep Reinforcement Lea... by throwawaygh on Tuesday July 13, 2021 @03:55PM (#27825522)
Strikes me as one of those cases where good research uses a silly motivation to get brownie points.

use p100s hosted in data centers powered by renewables, stop flying to conferences, don’t do drl just because it’s sexy

Re:Reducing the Computational Cost of Deep Reinforcement Lea... by monocasa on Tuesday July 13, 2021 @04:05PM (#27825631)
It reads to me as a response to Gebru's paper that led to her getting fired. A paper on the externalities of training large models, like the environmental impacts due to the large amount of computation required: "On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?"

https://dl.acm.org/doi/10.1145/3442188.3445922

That would explain why such a mundane subject is in a blog post, it's focused at tech news to be all "we really do care about this thing" rather than academia.

Re:Reducing the Computational Cost of Deep Reinforcement Lea... by visarga on Tuesday July 13, 2021 @05:59PM (#27826802)
> Can Language Models Be Too Big?

That's interesting, GPT-n with 100T parameters would be bored by just reading the whole internet. Too little information, repetitive and on average, junk.

You can try the question in reverse too: Can evolution use too much energy? How much energy has it already consumed?

Re:Reducing the Computational Cost of Deep Reinforcement Lea... by dna_polymerase on Wednesday July 14, 2021 @04:54AM (#27831004)
Why would they fire someone over this piece of shit paper? Does anyone think Google is threatened by the idea of AI using energy?
Re:Reducing the Computational Cost of Deep Reinforcement Lea... by pas on Wednesday July 14, 2021 @02:06AM (#27830155)
It was not the paper that get her fired. (Probably there isn't just one ultimate cause that led to her firing, but maybe we can say that big G has a tendency to fire those who rock the boat too loudly.)