Re:Mastering Chess and Shogi by Self-Play with General Reinf...
by allenz on Wednesday December 06, 2017 @06:22AM
(#15860257)
Compute absolutely matters. With tree search, there's a tradeoff between scoring cost and positions evaluated. AlphaZero can evaluate fewer positions because it uses a huge amount of compute to accurately score each position.
It's not just training. Training used 5,000 TPUs.
Re:Mastering Chess and Shogi by Self-Play with General Reinf...
by arcticfox on Wednesday December 06, 2017 @08:15AM
(#15860815)
Can't those teraflops be applied to evaluating more positions instead of deciding which positions to evaluate?
It seems that the metric should be compute time, not positions evaluated.
Re:Mastering Chess and Shogi by Self-Play with General Reinf...
by nl on Wednesday December 06, 2017 @09:30AM
(#15861243)
Presumably they both had equal clock time - that is a standard chess rule so it would be surprising to see it different.
Speed probably made the initial self play training quicker though.