Re:Minds Turned to Ash: Burnout is more than working too hard
by agumonkey on Saturday August 06, 2016 @07:27AM
(#12237763)
Can't too much exploration results in exhaustion too ? A drownout...
Re:Minds Turned to Ash: Burnout is more than working too hard
by visarga on Monday August 08, 2016 @07:36AM
(#12246900)
That's why it is called "tradeoff between exploration and exploitation". Exploration costs resources too, and has a lower chance of generating rewards in the short term. But without it agents can be stuck in a local minima without being able to "jump" to a better local minima.
It is true that in exploration there is no guarantee that a better reward will be found, but unless we explore, it's much harder to get to learn anything new and cut our future options. Our sorely missing downtime is exploration time, random choice time, free of expectations, liberated from the need to always make the greedy choice. We need more of that in order to explore the space of possibilities that exist beyond our experience. When we cut ourselves from randomness we box ourselves into the small space of known strategies, and burnout is just a negative reward signal to let us know we are being suboptimal even as we strive so much to excel.