Mastering Chess and Shogi by Self-Play with General Reinforcement Learning

Re:Mastering Chess and Shogi by Self-Play with General Reinf... by evandijk70 on Wednesday December 06, 2017 @04:16AM (#15859718)

Look at Figure 2, and remember that DM has access to a lot of hardware. At short thinking times, AlphaZero is weaker than Stockfish. This is equivalent to longer thinking times with weaker hardware, and it is likely that the former applications of NNs to chess had hardware that was a 1000-fold slower than what DM has access to. This means that even if the approach was identical to DMs, they would not have seen a better performance of NNs than the classical alpha beta approach.

[ Parent | on HN ]

Re:Mastering Chess and Shogi by Self-Play with General Reinf... by nojvek on Thursday December 07, 2017 @08:33AM (#15869816)

In essence MCTS + NN is just another way of tree search just like AlphaBeta or its brute force cousin Minimax.

AlphaZero just tries to be smarter about which branches to evaluate so it can go deeper.

But I would love to see AlphaZero (trained) run side by side with stockfish on an iPhone hardware and defeat it. That would be a more apples to apples comparison.

[ Parent | on HN ]