Re:Alpha Go Zero: How and Why It Works
by psb217 on Sunday November 05, 2017 @02:07PM
(#15630977)
Training via bootstrapping (i.e. dynamic programming) does reduce the state space for search when working with function approximation. It represents a bias in what sorts of values the value function approximator should predict for each state. It encodes a sort of "local continuity/coherence" constraint that wouldn't necessarily be induced by simply training to predict the raw values -- collected stochastically via interaction with the environment. This local coherence constraint acts as a regularizer (i.e. bias) while training the value function approximator.
[ Parent
| on HN ]
There are no comments on this comment yet.