Re:Impala: Scalable Distributed Deep Reinforcement Learning
by nazgul17 on Friday February 09, 2018 @03:48PM
(#16343696)
I don't think it will work well unless you have several actors. IIRC, one of the main factors giving A3C an edge compared to previous solutions, is that multiple learners from different episodes contribute experience at the same time. This avoids weights being updated too much in one direction. This is similar to what using batches does in supervised learning.
[ Parent
| on HN ]
There are no comments on this comment yet.