News for hackers. Stuff that matters.
Re:Mastering Chess and Shogi by Self-Play with General Reinf... by Cybiote on Wednesday December 06, 2017 @04:05AM (#15859680)
The difficulty of imperfect information is from cross cutting through information sets and partial observability. With perfect information games like chess or Go, one can solve subgames with guarantees that the equilibrium is the same as for the full game. This is not the case for games like poker, which is why they have been difficult. In addition to that, for n > 2 players, there are no longer theoretical guarantees about converging to a nash equilibrium, which makes designing theory guided algorithms harder. Though empirical performance with n=3 of CFR is encouraging, I know of no results for n > 3.

Earlier this year, DeepStack, a system combining neural nets with search, competed live against humans without any side being dominant. Search policy guided training might improve its results, which are impressive compared to even 5 years ago, but this highlights how much more demanding imperfect information games are.

Re:Mastering Chess and Shogi by Self-Play with General Reinf... by sharky6000 on Wednesday December 06, 2017 @05:03AM (#15859904)
Yep, this. Btw there are some encouraging results for n=4 using sequence form replicator dynamics (which are implementing a form of CFR) in Kuhn poker. Toy example but the game gets large fast with n=4. Don't know of any results with n > 4.

http://mlanctot.info/files/papers/aamas14sfrd-cfr-kuhn.pdf

Re:Mastering Chess and Shogi by Self-Play with General Reinf... by baq on Wednesday December 06, 2017 @05:04PM (#15865438)
i'm not sure deepmind would publish a paper in which they describe a winning high stakes online no limit holdem player. the ethics would be quite shady. for all we know, they might have already done that just to see if it works.