Re:Ke Jie will likely play AlphaGo before year's end
by kough on Monday June 06, 2016 @07:52AM
(#11846047)
Doesn't faster hardware allow it to navigate more of the search tree, in effect giving it more time to find better decisions?
[ Parent
| on HN ]
Re:Ke Jie will likely play AlphaGo before year's end
by _delirium on Monday June 06, 2016 @08:18AM
(#11846194)
Yes, the online hardware used during the game, vs. the offline hardware used for training the neural network, is mainly there to run a ton of monte carlo tree search (MCTS) iterations. MCTS tends to produce better estimates as you throw more compute power at it. In perfect-information, deterministic games, it theoretically converges on optimal play given infinite compute power, although in games with very large state spaces in practice that guarantee isn't too useful on its own, and the heuristic guidance provided by the NN is crucial.
Re:Ke Jie will likely play AlphaGo before year's end
by thomasahle on Monday June 06, 2016 @04:39PM
(#11850147)
In the paper they state that they tried giving it more power than the version that played Sedol, but found that it had rapidly decreasing marginal value, so they decided on a level that was pretty close to optimal.