News for hackers. Stuff that matters.
Re:Go master Cho wins best-of-three series against Japan-mad... by conanbatt on Thursday November 24, 2016 @04:40PM (#13032957)
This news has flewn way under the radar in comparison to the previous Match.

Cho Chikun is a legendary player ,and was top of the world in the 70's. From that era, along with Takemiya Masaki, he was one of the only ones that kept playing and kept winning titles even in his old age.

The style of 70's players was artistic and not as sports-like as koreans were when they rose in the 90's. They always showed a higher level of philosophy and art in game, but it was ultimately crushed by the "machine-like" tactical capacity of korean players. Cho chikun has very little chance to beat Lee sedol. But he was confident on beating Zen, and he did something unspeakable in the LeeSedol Matches: he came back from a losing game, from a machine that looked that would never relent its edges.

As a retired semi-professional Go player that learnt by replaying games from Cho Chikun, it is exciting to see the Japenese artistic and humane vision dominate the computer over the Korean Tactical sports-minded way.

Re:Go master Cho wins best-of-three series against Japan-mad... by gcp on Thursday November 24, 2016 @05:30PM (#13033192)
The news flies under the radar because for most people Go is now solved (compare to what happened after Deep Blue's win). There's a small blemish in that Ke Jie is still rated higher than AlphaGo. Perhaps they will rectify that, perhaps not.

Cho Chikun had the large advantage over Lee Sedol that his opponent (Zen) and similar programs (Crazy Stone, Leela) are simply available for him to practice against and probe for weaknesses.

Then of course there's also a significant reduction in the speed of the hardware.

Both of those matter a lot. I won't make a firm statement how relevant the style argument is you mention, but really, don't underestimate those two.

Re:Go master Cho wins best-of-three series against Japan-mad... by msbarnett on Thursday November 24, 2016 @06:02PM (#13033338)
> The news flies under the radar because for most people Go is now solved (compare to what happened after Deep Blue's win).

"Machines reaching a level of play that is consistently better than humans" and "the game is solved" are two completely different statements and it isn't particularly useful to conflate them.

We will likely never be able to solve Go in the formal sense.

Re:Go master Cho wins best-of-three series against Japan-mad... by hkmurakami on Thursday November 24, 2016 @06:10PM (#13033376)
The key though is "for most people". We live in a post-fact society, remember? ;)
Re:Go master Cho wins best-of-three series against Japan-mad... by rwallace on Friday November 25, 2016 @05:21PM (#13040269)
I don't think there is a factual disagreement here, just a terminology issue. Mathematical jargon is not quite the same language as plain English. In the former, 'solved' by default means you have found the mathematically perfect solution. In the latter, 'solved' by default just means you have found a solution good enough for practical purposes.
Re:Go master Cho wins best-of-three series against Japan-mad... by andrewflnr on Thursday November 24, 2016 @07:48PM (#13033746)
Quite. gcp is lamenting the same conflation as msbarnett.
Re:Go master Cho wins best-of-three series against Japan-mad... by new299 on Thursday November 24, 2016 @06:28PM (#13033434)
Go on smaller boards is solved (5x5). Solving on 9x9 or larger is likely not possible.
Re:Go master Cho wins best-of-three series against Japan-mad... by wallace_f on Thursday November 24, 2016 @10:13PM (#13034192)
>"Machines reaching a level of play that is consistently better than humans" and "the game is solved" are two completely different statements and it isn't particularly useful to conflate them.

Very good point

>We will likely never be able to solve Go in the formal sense.

I'm not sure if it would be precise to say chess will be solved either. The number of outcomes in a 50-move chess game approaches Graham's Number--a number larger than the number of atoms in the observable universe.

In a 100-move game, the number would be many orders of magnitude than an already incomprehensibly large number. So chess also will probably in a precise definition of the word, also never be solved.

Edit: It's kind of mind boggling to think about every atom in the universe representing one position in a game of chess and there not being enough atoms in the universe to represent each one.

Re:Go master Cho wins best-of-three series against Japan-mad... by RexetBlell on Thursday November 24, 2016 @11:08PM (#13034361)
The number of outcomes in a 50-move chess game does not even come close to the Graham's Number.

10^(number of outcomes in a 50-move chess games) also does not come close.

Re:Go master Cho wins best-of-three series against Japan-mad... by prezjordan on Thursday November 24, 2016 @11:48PM (#13034469)
Even 10^10^10... (repeat this the number of outcomes in a 50-move chess game) does not come close to Graham's number.
Re:Go master Cho wins best-of-three series against Japan-mad... by wallace_f on Friday November 25, 2016 @01:04AM (#13034665)
Thanks, I was wrong about that. I swore I read that somewhere, turns out it was on a chess forum--not a source I should have committed to long-term memory.

I did find this interesting statement about Graham's number (unsure of the veracity):

> Graham's number is greater than all of the Planck lengths in the universe. There literally isn't room in the universe to write it out in numerical form.

Edit: It looks like we confused Graham's Number for Shannon's number: https://en.wikipedia.org/wiki/Shannon_number

But according to the Wiki on Shannon's number, a the number of possible outcomes in chess does still far exceed the number of atoms in the universe: >Allis also estimated the game-tree complexity to be at least 10123, "based on an average branching factor of 35 and an average game length of 80". As a comparison, the number of atoms in the observable universe, to which it is often compared, is estimated to be between 4×10^79 and 4×10^81.

Re:Go master Cho wins best-of-three series against Japan-mad... by CJefferson on Friday November 25, 2016 @01:23AM (#13034703)
This is a bad kind of argument. There are more 16x16 sudoku boards, and ways of dealing a deck of cards, than there are atoms in the Universe too, but Sudoku and many card games are easy for computers to solve.
Re:Go master Cho wins best-of-three series against Japan-mad... by wallace_f on Friday November 25, 2016 @02:02AM (#13034821)
Well, you should volunteer on the Stockfish engine and show everyone how it's done.

I don't believe your comparison between fundamentally different games is sufficient to support your conclusion that an extremely large number of calculations does not pose a challenge for computer programs to solve.

Rather, to the best of my knowledge, to support your conclusion what you would need to do is to prove there exists a method or formula for reducing the number of permutations to a manageable number while still coming to an optimal solution. Apparently if Sudoku is easy to solve, that exists in Sudoku, but it certainly does not yet exist in the realm of human knowledge in chess.

The fact is that Sudoku and many card games are easy to solve, while chess is in fact a much, much more challenging problem for a computer program, and there are a lot of very smart people that have worked on that problem.

Re:Go master Cho wins best-of-three series against Japan-mad... by CJefferson on Friday November 25, 2016 @05:11AM (#13035595)
I don't disagree that Chess, and Go, and very hard. I don't believe without a major mathematical breakthrough we will see either solved, ever. There just isn't enough possible computing power in the universe.

HOWEVER, arguing that they aren't solvable purely from a point of view of "the number of possible games / states is greater than the number of particles in the universe" type arguments is that there are many problems we routinely solve with massive search spaces.

Re:Go master Cho wins best-of-three series against Japan-mad... by wallace_f on Friday November 25, 2016 @04:24AM (#13035359)
Your comment kind of bothers me. Probably because it is both wrong yet says in a rather frank, matter-of-fact way that my argument is bad.

Well, you could just do a Google search for yourself to see why your reasoning is wrong. The problem with using a computer to play Go is precisely what I described, the extremely high number of permutations involved, and it's the same concept with chess (Go just has even more of them): https://www.wired.com/2016/01/googles-go-victory-is-just-a-g...

Re:Go master Cho wins best-of-three series against Japan-mad... by CJefferson on Friday November 25, 2016 @05:14AM (#13035611)
Well, your comment bothered me, so we are all bothered!

I still disagree with your argument. The problem with Go isn't just the high number of permutations involved, there are real-world problems, with just as many permutations, which have been solved.

The extra problem with Go (and chess to a lesser degree) is that's it's incredibly hard to be sure, with any certainty, to be sure that a move is a "good" choice.

Comparing to the sudoku example again, when "playing" sudoku it's usually obvious as soon as you make a bad move, you've put two '1's in the same row/column/box for example. With Go if we want to play well, or perfectly, we really have to explore the entire search space.

Re:Go master Cho wins best-of-three series against Japan-mad... by wallace_f on Friday November 25, 2016 @06:28PM (#13040653)
What you're describing is this:

Sudoku is a game, and in which to solve it, a computer program has an obvious method to limit possible permutations to compute in finding a solution. In other words, it is not faced with the challenge of a requirement to compute permutations > 10^86 (roughly atoms in the observable universe).

In contrast to sudoku, chess and go are games which have no yet discovered or theoretical method to limit permutations to solve, therefore to solve them you would be required to computer permutations > 10^86.

So the problem is still with the number of permutations.

Like I said in my other post: if you could develop a technique to reduce the number of permutations while still solving the optimal solution then you would be onto something. Right now no one has been able to dream up such a theory and there are a lot of very smart people who have worked on this problem.

Re:Go master Cho wins best-of-three series against Japan-mad... by laxd on Thursday November 24, 2016 @11:01PM (#13034345)
> It's kind of mind boggling to think about every atom in the universe representing one position in a game of chess and there not being enough atoms in the universe to represent each one.

Chess players mentions this a lot. And then they consider chess a sport. For a sport, it shure is a mind boggingly low number of game states :)

(ps: I don't mean to start an uninteresting sport-or-not debate. It is what it is.)

Re:Go master Cho wins best-of-three series against Japan-mad... by YeGoblynQueenne on Friday November 25, 2016 @06:37AM (#13035982)
Something else- today you can run programs that play chess at superhuman levels on your phone. At the time of DeepBlue's win against Kasparov the same kind of system could run on off-the-shelve hardware [1]. Very soon after AI programs running on ordinary laptops demonstrated dominance against human masters (that's in Russel & Norvig, somewhere, I can dig it up if you like).

So the fact that Cho Chikun won against a less powerful machine is not necessarily an indication that the entire system is weaker than DeepMind's one. To know that you'd have to run Zen against AlphaGo.

______________

[1] A big hint of why it didn't is that, at the time, IBM was still selling more hardware than software.

Re:Go master Cho wins best-of-three series against Japan-mad... by YeGoblynQueenne on Friday November 25, 2016 @06:27AM (#13035938)
>> Cho Chikun had the large advantage over Lee Sedol that his opponent (Zen) and similar programs (Crazy Stone, Leela) are simply available for him to practice against and probe for weaknesses.

That's an argument against Go having been solved by AlphaGo, not for. If Lee Sedol could beat AlphaGo given the opportunity to practice against it, then nothing is solved.

Also, for a system to dominate against humans in a game it must be able to beat any opponent every time. AlphaGo hasn't demonstrated this yet, so while in the popular opinion AlphaGo "dominates", in the technical sense it does not, and Go won't be "solved" conclusively until it has.

Re:Go master Cho wins best-of-three series against Japan-mad... by brilliantcode on Friday November 25, 2016 @01:06PM (#13038637)
> There's a small blemish in that Ke Jie is still rated higher than AlphaGo.

This is false. Ke Jie is far far below Lee Sedol.

Lee Sedol has no equal. Well, AlphaGo beat him but we are talking about player ranks.

Re:Go master Cho wins best-of-three series against Japan-mad... by hellbanner on Thursday November 24, 2016 @08:17PM (#13033824)
Speed of the hardware is significant to discuss. A human, given sufficent notebook paper & time, could think ahead for thousands of years and thousands of turns -- this is effectively what a machine is doing.

With much tighter time constraints, I don't believe machines would do as well because they are using full-breadth search (to my knowledge) -- searching every possibliity. Whereas humans use visual pattern recognition, and we can run this programs quite fast.

Re:Go master Cho wins best-of-three series against Japan-mad... by jjaredsimpson on Thursday November 24, 2016 @09:25PM (#13034027)
machines use aggressive tree pruning. they don't evaluate all positions
Re:Go master Cho wins best-of-three series against Japan-mad... by hellbanner on Friday December 02, 2016 @02:20PM (#13091445)
Thanks. Even so, they still compute the full value of the move, right? Queens are 9 points, pawns are 1 etc, this position is worth X
Re:Go master Cho wins best-of-three series against Japan-mad... by espadrine on Thursday November 24, 2016 @05:03PM (#13033062)
Isn't it plausible that DeepZenGo simply isn't at the level of play of AlphaGo? Facebook's DarkForest is also a competent AI, but even it does not compete yet.
Re:Go master Cho wins best-of-three series against Japan-mad... by gcp on Thursday November 24, 2016 @05:20PM (#13033138)
It's hard to compare, as even Deep Zen runs on much more...modest...hardware than the match version of AlphaGo did. It's conceivable that AlphaGo would get clobbered on Zen's hardware, or that Zen would clobber AlphaGo if that team had Google-eseque resources available. But there's no reason to believe we'd ever see such a fair comparison. It makes no sense for either team!

Zen is commercial software sold to people with a normal PC, so obviously reaching AlphaGo performance on AlphaGo hardware does their customers no good either.

It's for sure stronger than Darkforest. Some free PC programs like Leela have reached Darkforest levels on normal PC hardware (Darkforest used 44 NVIDIA Tesla cards, Leela uses a single normal "gaming" GPU), and Zen is several stones stronger than Leela.

Re:Go master Cho wins best-of-three series against Japan-mad... by sams99 on Thursday November 24, 2016 @09:03PM (#13033952)
"Zen is commercial software sold to people with a normal PC"

Note, it looks like only version 6 is out:

https://book.mynavi.jp/ec/products/detail/id=62646

It appears that DeepZen would be a new version that is not quite yet released to the public.

Re:Go master Cho wins best-of-three series against Japan-mad... by tasuki on Thursday November 24, 2016 @05:40PM (#13033250)
Not just plausible, it's pretty damn sure.

Still, major props to Hideki Kato, who's developing cutting edge AI at the age of 62. I wish to have his drive at that age!

Re:Go master Cho wins best-of-three series against Japan-mad... by gcp on Thursday November 24, 2016 @05:43PM (#13033259)
Not just plausible, it's pretty damn sure.

Your certainty is based on what data?

Re:Go master Cho wins best-of-three series against Japan-mad... by cybertronic on Thursday November 24, 2016 @06:37PM (#13033477)
Re:Go master Cho wins best-of-three series against Japan-mad... by gcp on Friday November 25, 2016 @07:07AM (#13036131)
A rating based on 3 games has a pretty high (read: enormous) error margin.
Re:Go master Cho wins best-of-three series against Japan-mad... by WilliamDhalgren on Monday November 28, 2016 @04:15AM (#13054297)
A rather similar hardware with a recent version of the same program plays on the KGS server. Seems to be about what would be 10d and is among the top players on the server (was 1., now seems to be 3.).

You can see the graph of its playstrength; its quite impressive to see the gains Zen got from implementing ValueNet (and previously with PolicyNet) really.

https://www.gokgs.com/graphPage.jsp?user=Zen19K2

Hardware for ZenK2 was given on computer-go mailinglist:

Zen19K2's information is

------------------------------------- Computer program Zen running on KURISU server provided by DWANGO.

CPU: Xeon E5-2623 v3 x2 GPU: GeForce GTX TITAN X x4

http://computer-go.org/pipermail/computer-go/2016-October/00...

author of Zen gave the hardware behind this match, in a post to the same mailinglist as:

http://computer-go.org/pipermail/computer-go/2016-November/0...

CPU: 2 x Intel Xeon E5-2699v4 (44 cores/2.2 GHz) GPU: 4 x nVidia Titan X (Pascal ) RAM: 128GB

So rather similar.

~10d is way way lower than what AlphaGo had to be to play on par with one of the top players of Go. Pro ranks start around or just above the KGS 9d (which is around what a 7d rank would be for regular amateurs in most world amateur organisations). A rough approximation is that you can take 3-4 pro ranks for each dan rank/stone of handicap (well, to the extent one can even approximate strength by the rank, as a rank once won is kept for life, so as you age and young pro players pass you by, your rating is getting inflated). So apriori you could expect Zen to play around middling pro ranks, and maybe around the strength of the v13 of AlphaGo, the one that beat Fan Hui, and described in the Nature paper. And that's about what his play with Chikun indicates as well.

Cho Chikun's rating is 3239, while Lee Sedol's is 3508. so around 300 elo difference, which seems a conservative estimate of the difference scale (and the results of the two matches do indicate, if weakly, that the actual difference is even larger). A 230 point gap corresponds to a 79% probability of winning.

For comparison, distributed AlphaGo v13, the one that played vs Fan Hui is 250 elo points stronger than a single machine version of the same version of AlphaGo.

Also if that would carry any weight with you, you could just take it on the say-so of Myungwan Kim 9p, who was doing commentary on both DeepZen and AlphaGo matches. Really the difference in strength seems rather obvious to such a strong go player, as you can see in the way he criticized some DeepZen's moves, and how impressed he was with so many of AlphaGo's.

Re:Go master Cho wins best-of-three series against Japan-mad... by zump on Thursday November 24, 2016 @06:38PM (#13033479)
What is the key to remaining agile at that age?

So many of my coworkers seem to have lost intellectual curiosity as they have gotten older.

Re:Go master Cho wins best-of-three series against Japan-mad... by chris_st on Friday November 25, 2016 @07:54AM (#13036368)
My own personal opinion is embodied in the phrase, "You don't stop playing games because you get old, you get old because you stop playing games."

I'm fairly close to retirement, and have friends who are getting there (or retired already). I really enjoy programming, and intend to continue indefinitely; most of my friends tolerate it as a job, and look forward to not doing it when they retire.

So it's the old "follow your passion" thing, again, I guess... I have that curiosity about such things, they don't.

Re:Go master Cho wins best-of-three series against Japan-mad... by nv-vn on Thursday November 24, 2016 @06:14PM (#13033388)
This sounds a lot like video games like StarCraft and Overwatch today. Korean competitive gamers have achieved the same kind of machine-like skill. In the Overwatch World Cup this year, not only did the Korean team go undefeated, but they massively crushed their opponents (even in the final game!).
Re:Go master Cho wins best-of-three series against Japan-mad... by taejavu on Thursday November 24, 2016 @06:17PM (#13033399)
There's even a joke that the currency of prize money for all international StarCraft tournaments should be the Korean Won.
Re:Go master Cho wins best-of-three series against Japan-mad... by chunsj on Thursday November 24, 2016 @11:03PM (#13034354)
Cho is a korean as well. Though I'm not sure on his current nationality. Yes, there might be some difference in the style of playing Go, which I do not know the detail.
Re:Go master Cho wins best-of-three series against Japan-mad... by conanbatt on Friday November 25, 2016 @02:38AM (#13034940)
For the purposes of Go, he is japanese. He learnt Go from Kitani Minoru from age 5-6, and he became a professional player at 11~ breaking records for his time (if I recall correctly). Back in the 70's japan was everything for Go.
Re:Go master Cho wins best-of-three series against Japan-mad... by convolvatron on Thursday November 24, 2016 @08:39PM (#13033889)
i play go, nowhere near the retired semi-professional level

my backwater go community doesnt really care about computers because we're too focussed on trying not to be so lousy, and on the conversation. the light chase.

i'm super curious...when you see alpha against sedol, or whatever this is against chikun. do you read something there? is there a character?

Re:Go master Cho wins best-of-three series against Japan-mad... by conanbatt on Friday November 25, 2016 @12:49PM (#13038479)
About 4 years ago, a friend i know used a 3-4d level computer against me for a fraction of his game. I noticed something was off, i actually thought he was being substituted, but it didnt cross my mind it was a bot. However, it was a very tactical situation.

Looking at alpha, something similar but at higher level happens: it looks so profoundly tactical that its hard to catch character from it. I can tell how Lee felt however: like i felt playing people close to his level, like you play a wall that you cant read.

Re:Go master Cho wins best-of-three series against Japan-mad... by thomasahle on Thursday November 24, 2016 @05:10PM (#13033085)
Computers losing to Machines in Go is not yet that surprising. The article doesn't really give any reasons to why we should have expected something else. Perhaps the main news worthy part was that the machine actually won a game. But then we don't really know how strong its opponent is today.
Re:Go master Cho wins best-of-three series against Japan-mad... by gcp on Thursday November 24, 2016 @05:36PM (#13033230)
we don't really know how strong its opponent is today

He's not exactly retired, you know: https://www.goratings.org/players/98.html

Re:Go master Cho wins best-of-three series against Japan-mad... by deegles on Thursday November 24, 2016 @10:05PM (#13034151)
What bothered me about AlphaGo was the sheer amount of power that was dedicated to training and running it vs. the relatively puny power budget a human has.

i.e. "Lee Sedol used about 20 Watts of power to operate. By contrast, AlphaGo runs on a whopping 1920 CPUs and another 280 GPUs for an estimated power consumption of approximately 1 MW (200 W per CPU and 200 W per GPU). That’s 50,000 times as much power as the amount of power that Lee Sedol’s brain uses and the two are not quite evenly matched but it is close enough to use for comparison."[0]

I mean, sure, it's apples to oranges, but it feels like a pyrrhic victory to have to use 1MW of computing power to beat a 20w brain.

I want there to be a series of AI vs. AI games where everyone has an equal power budget for their AI. Everyone has to bring their own equipment and they receive exactly X kwh from a calibrated power supply to train their model. Training data could possibly also be standardized.

Each team would received a standardized power supply for the actual competition (e.g 20w). There could be bonuses for using less energy for training or during gameplay, or for faster response times between moves.

I believe this would drive innovation in building special purpose hardware, more efficient training models, and so on.

[0] http://jacquesmattheij.com/another-way-of-looking-at-lee-sed...

Re:Go master Cho wins best-of-three series against Japan-mad... by mrob on Friday November 25, 2016 @02:54AM (#13034992)
Lee Sedol did not use 20W, because he is not a disembodied brain. A non-exercising human is usually approximated as using 100W.
Re:Go master Cho wins best-of-three series against Japan-mad... by monix on Friday November 25, 2016 @02:03AM (#13034827)
On the other hand AlphaGo proves that computers can scale, even if they are inefficient, whereas the only way to grow that 20 Watts brain would be to use multiple brains and that's not going to be any good in Go matches.
Re:Go master Cho wins best-of-three series against Japan-mad... by argonaut on Friday November 25, 2016 @06:40AM (#13035998)
On the contrary, I think there is a real question over whether AlphaGo would be able to beat a group of 3-5 tier-1 Go players (e.g. ~top 10 rankings players) who were allowed to write things down on paper, discuss, use whiteboards, use separate game boards to play variations, etc, even with same time controls.
Re:Go master Cho wins best-of-three series against Japan-mad... by arcticfox on Friday November 25, 2016 @01:55AM (#13034798)
why optimize for power? You can't create a megawatt human, that's our limitation that is being shown in these matches. power would just be a weird artificial constraint.
Re:Go master Cho wins best-of-three series against Japan-mad... by monix on Friday November 25, 2016 @02:07AM (#13034842)
Even though an argument can be made about computers being able to scale, energy is always the only constraint that matters.
Re:Go master Cho wins best-of-three series against Japan-mad... by Veratyr on Friday November 25, 2016 @03:51AM (#13035198)
> energy is always the only constraint that matters

Simply making a statement like this doesn't really say much. You really need to back it up with evidence, justification and/or reasoning, or at least elaborate on it a little.

Re:Go master Cho wins best-of-three series against Japan-mad... by rcthompson on Thursday November 24, 2016 @10:15PM (#13034203)
> Everyone has to bring their own equipment and they receive exactly X kwh from a calibrated power supply to train their model

What's the advantage of this over simply providing every team with identical hardware and equal computing time? It seems like providing a fixed power supply would favor whoever can afford to buy more efficient computing equipment.

Re:Go master Cho wins best-of-three series against Japan-mad... by deegles on Thursday November 24, 2016 @11:02PM (#13034348)
Developing special purpose machine learning hardware is part of the goal. I think of it like Formula 1, where the R&D eventually trickles down to consumer hardware.

Also, there's no reason why you couldn't have different competition categories where you're limited to using X dollars worth of time on a specific cloud provider, for example.

Re:Go master Cho wins best-of-three series against Japan-mad... by meric on Thursday November 24, 2016 @10:32PM (#13034253)
Measuring by power supply allows human participants if the limit is 20W.
Re:Go master Cho wins best-of-three series against Japan-mad... by TwoBit on Thursday November 24, 2016 @11:57PM (#13034488)
Identical hardware limits you.
Re:Go master Cho wins best-of-three series against Japan-mad... by shard on Friday November 25, 2016 @07:17PM (#13040908)
Another difference between the human brain and a computer is the number of round of hardware optimization. Human brains have millions of years and millions of search paths explored, while computer hardware, although advancing at a much faster pace, is still a relatively new technology.
Re:Go master Cho wins best-of-three series against Japan-mad... by Radim on Thursday November 24, 2016 @10:44PM (#13034290)
"Meh" news because we had a higher profile match just recently: AlphaGo vs Lee Sedol (both much stronger than DeepZen or Cho).

I mean, it's mildly interesting that DeepZen uses fewer resources (just ~40 CPUs and 4 GPU, compared to AlphaGo's ~2k CPU and ~200 GPUs, IIRC). But that's relevant only to hardcore Go enthusiasts who would want to run such AIs on their own hardware.

In contrast, the next interesting milestones in Go AI are:

* AI beating a team of cooperating top pros, say top-10 humans vs AI (easy)

* solving Go (hard)

* finding ways to translate insights gained from observing strong Go AI into real-life situations relevant outside of Go (my personal favourite; Go has that fascinating simple-meets-complex abstracting property [1])

[1] https://rare-technologies.com/go_games_life/

Re:Go master Cho wins best-of-three series against Japan-mad... by adrianN on Friday November 25, 2016 @02:35AM (#13034928)
I think the next interesting milestone would be beating top rated humans using commodity hardware. In chess for example, programs running on cell phone processors have Elo rating around 2800. Using weaker hardware means that the algorithms need to have more insight into the game and can't rely as much on exploring the game tree.
Re:Go master Cho wins best-of-three series against Japan-mad... by pelario on Friday November 25, 2016 @04:34AM (#13035409)
> * AI beating a team of cooperating top pros, say top-10 humans vs AI (easy)

It is not clear at all that the cooperating team is more difficult to beatä

> * solving Go (hard) Not only hard, but 'solving Go' it is beyond AI, and probably cannot be done.

* finding ways to translate insights gained from observing strong Go AI into real-life situations relevant outside of Go (my personal favourite; Go has that fascinating simple-meets-complex abstracting property [1])

Here I fully agree, as conan noted in another thread, stylistic factors are quite important, and the art-like approach is a thing in Go, so I would love to know "what the AI thinks about it" :)

Re:Go master Cho wins best-of-three series against Japan-mad... by emptybits on Thursday November 24, 2016 @11:52PM (#13034477)
> * solving Go (hard)

1. Perfect play from any game position.

2. Proof of perfect play.

#1 may be achievable with a sufficiently clever algorithm. (We may suspect it is perfect and may only later prove it.) #2 may be much much harder. Neither are suitable for brute force approaches to play or proof as some problem spaces are.

Re:Go master Cho wins best-of-three series against Japan-mad... by qznc on Friday November 25, 2016 @03:58AM (#13035229)
The next interesting non-Go milestone seems to be Starcraft ;)
Re:Go master Cho wins best-of-three series against Japan-mad... by partycoder on Thursday November 24, 2016 @09:37PM (#13034068)
It depends on many things... such as the game data used to train it and the hardware in which it ran, the time settings of the game, the implementation of the algorithm, etc.

But so far commentators such as Ke Jie (higher rating than Lee Sedol), said that Deep Zen Go's yose (end-game) is very weak compared to Alpha Go.

Another factor is that Cho Chikun had the advantage of studying more MCTS/DL bot games. Today you can find MCTS/DL bots in servers such as KGS that you can play against.

Cho Chikun had more clear expectations of the bot playing level. e.g: Lee Sedol greatly underestimated Alpha Go initially, then he was in shock and did not know what to expect. Your playing strategy can vary depending of strengths and weaknesses of your opponent.

Re:Go master Cho wins best-of-three series against Japan-mad... by fiatjaf on Thursday November 24, 2016 @05:36PM (#13033227)
What happened to chess enthusiasts when chess was "solved"?
Re:Go master Cho wins best-of-three series against Japan-mad... by olalonde on Thursday November 24, 2016 @06:39PM (#13033484)
The best computers now consistently beat the best humans but "solved" has a precise definition in game theory and it isn't completely solved under that definition[0]. With regards to your question, I can't say for sure but my impression is that interest in chess has declined a lot.

[0] https://en.wikipedia.org/wiki/Solving_chess

Re:Go master Cho wins best-of-three series against Japan-mad... by imaginenore on Thursday November 24, 2016 @09:54PM (#13034119)
That's an understatement.

The best computer algos beat humans at chess by a huge margin, to the point a regular PC beats Carlsen (and I heard even the best smartphone apps beat him).

Carlsen's ELO rating = 2853

Top chess program ELO rating = 3381

The number of DIFFERENT programs stronger than Carlsen = 59

http://www.computerchess.org.uk/ccrl/4040/

https://ratings.fide.com/top.phtml?list=men

Re:Go master Cho wins best-of-three series against Japan-mad... by espadrine on Thursday November 24, 2016 @07:17PM (#13033657)
> my impression is that interest in chess has declined a lot.

I don't think it has. Much like horseback riding has not made olympic races obsolete, human competition remained fascinating. I for one very much followed the rise of Magnus Carlsen.

Re:Go master Cho wins best-of-three series against Japan-mad... by olalonde on Thursday November 24, 2016 @07:37PM (#13033727)
That was a poorly chosen example since interest in horseback riding has declined a lot, at least in relative terms, compared to the pre car days. Today, auto racing as a competitive sport is probably more popular too.

Personally, the fact that computers are better at chess than humans makes me less interested in the game so I'm a bit biased.

Re:Go master Cho wins best-of-three series against Japan-mad... by dmoy on Thursday November 24, 2016 @11:09PM (#13034364)
The argument is that the presence of horseback riding (and now race car driving) doesn't necessarily diminish the popularity of foot races. Not that horse racing is less popular now (though that my be, simply because it's no longer anyone's preferred method of transportation...)
Re:Go master Cho wins best-of-three series against Japan-mad... by olalonde on Friday November 25, 2016 @01:31AM (#13034732)
Ah, I missed that. It's hard to say with certainty whether horseback riding diminished the popularity of foot races since it happened such a long time ago and at a time where probably neither was considered a sport or entertainment.

I do think that technological advances in general affect the appeal of certain games and sports by rendering them less mysterious or by bringing them further from a real world activity/situation.

Of course, I'm talking about relative, not absolute, popularity. Chess and horseback riding will remain popular for a long, long time.

Re:Go master Cho wins best-of-three series against Japan-mad... by andrepd on Thursday November 24, 2016 @07:14PM (#13033641)
>With regards to your question, I can't say for sure but my impression is that interest in chess has declined a lot.

It hasn't, in the slightest. The fact that computers playing at full strength can beat top humans makes no difference in the enjoyability of the game for people.

Re:Go master Cho wins best-of-three series against Japan-mad... by exolymph on Thursday November 24, 2016 @06:12PM (#13033382)
They kept playing chess with each other.
Re:Go master Cho wins best-of-three series against Japan-mad... by cybertronic on Thursday November 24, 2016 @06:30PM (#13033440)
and chess was not "solved"
Re:Go master Cho wins best-of-three series against Japan-mad... by partycoder on Thursday November 24, 2016 @09:44PM (#13034082)
Solving chess would mean having the perfect move as a response to every move. In that sense, chess is far from being solved.
Re:Go master Cho wins best-of-three series against Japan-mad... by jm547ster on Thursday November 24, 2016 @06:34PM (#13033451)
Computer aided chess became a game in and of itself
Re:Go master Cho wins best-of-three series against Japan-mad... by brilliantcode on Thursday November 24, 2016 @06:54PM (#13033552)
> Cho won a close game 1,[28] lost game 2 when his invasion into enemy territory was killed,[29] and won game 3. Zen uses neural network techniques similar to AlphaGo,[30] however ran on more modest hardware during the match.

not sure if suggests any comparison between AlphaGo and Zen. I'd like to see Cho play against AlphaGo.

Re:Go master Cho wins best-of-three series against Japan-mad... by iopq on Thursday November 24, 2016 @08:30PM (#13033862)
Cho Chikun would not stand a chance against AlphaGo. AlphaGo has shown itself to be stronger than Lee Sedol, who is much stronger than Cho.
Re:Go master Cho wins best-of-three series against Japan-mad... by bluetwo on Friday November 25, 2016 @02:10AM (#13034853)
OK, can't we just have Zen and AlphaGo play each other?
Re:Go master Cho wins best-of-three series against Japan-mad... by gcp on Friday November 25, 2016 @07:15AM (#13036170)
What would the upsides of such a match be for AlphaGo?

How many matches with other computers did Deep Blue play after its victory over Kasparov? (zero)

How many world championships did Deep Blue win? (zero, it played one in 1995 and lost to Fritz)

How many people tought Deep Blue was the strongest computer in the world in 1996? (All of them, because IBM said so and conveniently forgot about the lost world championship)

Google has already said AlphaGo is much stronger than other programs. There's no point in playing a match then, is there?

Re:Go master Cho wins best-of-three series against Japan-mad... by bluetwo on Sunday November 27, 2016 @01:07AM (#13047978)
Errrrrr.... It would shut up Zen go or prove them right? That seems like a reason.