News for hackers. Stuff that matters.
Re:How much did AlphaGo Zero cost? (2018) by air7 on Thursday June 11, 2020 @08:37AM (#23488134)
Is human&computer better than computer only?
Re:How much did AlphaGo Zero cost? (2018) by luisvictoria on Thursday June 11, 2020 @09:00AM (#23488324)
Not really, humans barely provide insight (if anything), which chess engines don’t already consider. Deep Blue could evaluate 200 million different moves... per second. And that’s from 1997.

The few and rare times an engine gets funky is usually in end-game positions where the engine can’t seem to find a sacrifice to win the game and will output a current position as drawn. These cases are few and I very much doubt that a human would be able to find these moves in an actual match.

Now if you’re talking about the way the chess engine learns, it can learn in two different ways: without human help (learning completely on its own giving it nothing but the rules which is how AlphaGo works), or with human aid (through chess theory accumulated over centuries of human matches that these engines have built in as part of their evaluations). Things get very interesting.

I’d recommend you to look up a few games between AlphaGo and Stockfish, which embody these two different philosophies and battle it to the teeth and bones. The matches are brilliant. I would say though that it seems like AlphaGo (learning the game entirely through scratch without human help) has seemed to triumph more times than Stockfish and with the nature of these systems, I’d suspect it to continue that trend.

Re:How much did AlphaGo Zero cost? (2018) by marksweston on Thursday June 11, 2020 @09:20AM (#23488534)
I'm not sure it's right to characterise Deep Blue or Stockfish as repositories of human chess theory. Fundamentally they were all based on a relatively simplistic function for calculating the value of a board position combined with the ability to evaluate more board positions further into the future than any human possibly could (plus a database of opening moves). That approach seems thoroughly non-human, and represents a victory of tactical accuracy over chess theory or strategy.

However I agree that the games between AlphaGo and Stockfish are really interesting. It strikes me that the AlphaGo version of chess looks a lot more human; it seems to place value on strategic ideas (activity, tempo, freedom of movement) that any human player would recognise.

Re:How much did AlphaGo Zero cost? (2018) by luisvictoria on Thursday June 11, 2020 @12:05PM (#23490272)
I think you're right, I meant to say that chess engines usually have book openings built into them which derive off of human chess theory but you're absolutely right in that they don't play in a human form.

It's kind of crazy how AlphaZero has managed the success it has. Stockfish calculates roughly 60 million moves per second and AlphaZero calculates at only 60 thousand per second. Three orders of magnitude less yet its brilliance is mesmerizing, tearing Stockfish apart in certain matches.

Re:How much did AlphaGo Zero cost? (2018) by JoeDaDude on Thursday June 11, 2020 @12:48PM (#23490723)
> ...learning completely on its own giving it nothing but the rules which is how AlphaGo works...

Not to be too picky, but it was AlphaGo _Zero_ that learned from the rules alone. AlphaGo learned from a large database of human played games: "...trained by a novel combination of supervised learning from human expert games". [1]

AlphaGo Zero, derived from AlphaGo, was "an algorithm based solely on reinforcement learning, without human data, guidance or domain knowledge beyond game rules". [2]

[1] https://www.nature.com/articles/nature16961

[2] https://pubmed.ncbi.nlm.nih.gov/29052630/

Re:How much did AlphaGo Zero cost? (2018) by klipt on Thursday June 11, 2020 @02:57PM (#23492164)
Also AlphaGo Zero never played chess, only go. It was AlphaZero that applied the same framework to other games including chess.

https://en.wikipedia.org/wiki/AlphaGo_Zero https://en.wikipedia.org/wiki/AlphaZero

Re:How much did AlphaGo Zero cost? (2018) by sharedfrog on Thursday June 11, 2020 @01:56PM (#23491512)
> I’d recommend you to look up a few games between AlphaGo and Stockfish

Agadmator's youtube channel covers a bunch of those. https://www.youtube.com/watch?v=1yM0D1iZLrg

Re:How much did AlphaGo Zero cost? (2018) by bsder on Thursday June 11, 2020 @05:05PM (#23493286)
And some of the most amazing games are when AlphaGo is absolutely breaking chess "wisdom" left and right simply because it can see a forced solution on the horizon.

Pawn structure? BAH! King safety? CHARGE!

And then 75 moves later Stockfish is in zugzwang.

Re:How much did AlphaGo Zero cost? (2018) by andrepd on Thursday June 11, 2020 @09:57AM (#23488928)
>Deep Blue could evaluate 200 million different moves... per second. And that’s from 1997.

And still he lost against Kasparov. Which doesn't happen now, top engines haven't been beaten by humans since ~2006.

Re:How much did AlphaGo Zero cost? (2018) by pps43 on Thursday June 11, 2020 @08:47AM (#23488213)
Not really. It was tried and it turns out that the best strategy for the human is to just do what the computer suggests.
Re:How much did AlphaGo Zero cost? (2018) by Strilanc on Thursday June 11, 2020 @03:35PM (#23492548)
Could you provide a source for this?
Re:How much did AlphaGo Zero cost? (2018) by tuxiano on Thursday June 11, 2020 @04:44PM (#23493113)
I suppose he can’t because it isn’t true at all. The best correspondence players usually improve significantly over the computer suggestions.

Source: I’m a corrspondence chess international master

Re:How much did AlphaGo Zero cost? (2018) by vecter on Thursday June 11, 2020 @04:57PM (#23493224)
> The best correspondence players usually improve significantly over the computer suggestions.

I might be misunderstanding your claim, but how can humans playing correspondence chess beat Stockfish or Lc0?

Re:How much did AlphaGo Zero cost? (2018) by tuxiano on Thursday June 11, 2020 @05:15PM (#23493357)
In official correspondence games the computer assistance is allowed so most (if not all) of the players usually start their analysis with the computer suggestions (Stockfish, Lc0 or others). Some players limit themselves to this and play the engine's move, others try to improve with their own contribution. If no human contribution was possible, correspondence chess would become an hardware fight while results show that the best players can defeat "naive" opponents that rely on computer suggestions. In this sense, every correspondence chess win is a win over the opponent's hardware and engine.
Re:How much did AlphaGo Zero cost? (2018) by vecter on Thursday June 11, 2020 @05:41PM (#23493570)
Isn't it possible that you're not improving upon the engine's suggestions, but instead, your opponent is choosing suboptimal non-engine lines, and your engine is beating their weakened engine?
Re:How much did AlphaGo Zero cost? (2018) by tuxiano on Thursday June 11, 2020 @06:21PM (#23493883)
Occasionally it is possible. After seven years and more than one hundred games played I can tell you that I have been surprised by my opponent's reply not more than an handful of times. For "surprised" I mean he didn't play the top choice of the engine. In fact most of the times the best move in a given position is easily agreed on by any reasonable engine on any decent hardware. In few critical moments in the game, the best move is not clear and there are two or three or more playable alternatives that take into very different positions. In these cases the computer, after a long thought (one or more hours) usually converges to one suggestion and sticks to it even if given more time (a sort of "horizon effect"). These are the moments where a human, after a long thought, can overcome the computer suggestion and favor the 2nd or 3rd choice of the engine. So in brief no, I can't recall a game where I've been gifted the win by my opponent "weakened" move while most of the time I have confronted with the "engine's approved" suggestion and had to build my win by refuting it.
Re:How much did AlphaGo Zero cost? (2018) by vecter on Thursday June 11, 2020 @06:32PM (#23493964)
I assume that when you come across one of these novel moves, plug it into the computer, and give it time to search, it ultimately decides that it's superior?

Relatedly, can you give some examples of novel non-engine lines that turned out to be better than engine lines?

Re:How much did AlphaGo Zero cost? (2018) by tuxiano on Thursday June 11, 2020 @07:18PM (#23494236)
Sometimes if you play a move and the first plies (i.e. half moves) of the main variation the computer starts "understanding" and its score changes accordingly. Those are the cases where more hardware power could be useful and make the engine realize the change from the starting position. More often, the "non-engine" move relies on some blindness of the engine, so the computer starts understanding its strength only when it's too late. In these cases is unlikely that more power could bring benefits. Typical cases are

- fortresses [0]. One side has more material but the position can't be won by the superior side. As the chess rules declare the draw only after 50 moves without captures or pawn pushes, current engines can't look this far away and continue manouvering without realizing the blocked nature of the position. Some engines have been programmed to solve this problem but their overall strength decreases significantly.

- Threefold repetitions [1]. The engine believes the position is equal and move the pieces in - let me say - pseudorandom way. Only at some point it realizes the repetition can be avoided favourably by one side. Also this topic is frequently discussed in the programming forums but no clearcut solution has still emerged.

If you are looking for positions where human play is still better than engine's, the opening phase is the most fruitful. Most theoretical lines were born by human creativity and I doubt a chess engine will ever be able to navigate the intricacies of the Poisoned Pawn Variation of the Sicilian Najdorf [2] or the Marshall Attack of the Ruy Lopez [3]. Neural networks engines are strategically stronger than classical AB programs in the opening phase but they suffers from occasional tactical blindness. Engine-engine competitions often use opening books to force the engines to play a prearranged variation to increase the variabililty and reduce the draw percentage.

[0] https://en.wikipedia.org/wiki/Fortress_(chess) [1] https://en.wikipedia.org/wiki/Threefold_repetition [2] https://en.wikipedia.org/wiki/Poisoned_Pawn_Variation [3] https://en.wikipedia.org/wiki/Ruy_Lopez#Marshall_Attack

Re:How much did AlphaGo Zero cost? (2018) by roenxi on Thursday June 11, 2020 @05:36PM (#23493519)
I'm interested because the experience in Go is humans simply can't keep up.

What is the evidence that it isn't a hardware or software differential between the players? I can't think of an easy way to ensure that both players started with computer-suggested moves of the same quality.

Re:How much did AlphaGo Zero cost? (2018) by tuxiano on Thursday June 11, 2020 @06:45PM (#23494040)
There are a lot of engines with rating on the chart way higher than the best humans, so every suggestion on their part should be in theory enough to overcome any human opponent. In practice most (if not all) of the players rely on Stockfish and Lc0 (both open source). During a game, most of the time the "best" move is easily agreed on by every reasonable engine on any decent hardware. Only in few cases during a game, the position offers two or three or more playable choices. In these cases a stronger hardware or a longer thought rarely makes the computer change his idea. It's a sort of horizon effect where more power doesn't translate into a really better analysis.

For example in a given position you could have 3 moves M1 - a calm continuation with a good advantage M2 - an exchange sacrifice (a rook for a bishop or a knight) for an attack M3 - a massive exchange of pieces entering into a favorable endgame. If the three choices are so different, the computer usually can't dwell enough to settle on a clear best move. Instead the human can evaluate the choices until one of them shows up as clearly best (for example the endgame can be forcefully won). In these cases the computer suggestion becomes almost irrelevant and only a naive player would make the choice on some minimal score difference (that can unpredictably vary on hardware, software version or duration of analysis). So the quality of the starting suggestion is somehow irrelevant if you plan to make a thoughtful choice.

Re:How much did AlphaGo Zero cost? (2018) by sp332 on Thursday June 11, 2020 @09:28AM (#23488618)
I'm not sure about very recent chess engines, but for a long time, it was better. The human suggests several moves that would advance their strategy, and the computer dedicates its search time to evaluating the strength of those potential moves, which cuts down the search space considerably. It's called "advanced chess" or "centaur chess". https://en.wikipedia.org/wiki/Advanced_chess
Re:How much did AlphaGo Zero cost? (2018) by JamesBarney on Thursday June 11, 2020 @10:42AM (#23489429)
No.

Computers are now as much better than Magnus Carlsen as he is better than a moderate amateur.

If even the best player overrides a move he's much more likely to be reducing the strength of the move than increasing it.

Re:How much did AlphaGo Zero cost? (2018) by tuxiano on Thursday June 11, 2020 @04:57PM (#23493220)
The rating you are referring to are typically based on tournament or rapid games, where the limited time induces the human players to mistakes that the computer capitalizes on. Given enough time or with a “blunder check” option, the best human players are still strategically stronger. In correspondence chess, where the is much more time at disposal, the human players can still improve the computer suggestions.

Source: I’m a correspondence international chess master

Re:How much did AlphaGo Zero cost? (2018) by JamesBarney on Thursday June 11, 2020 @05:23PM (#23493407)
Yeah I was thinking about classic or standard time controls. The last big cyborg tournament a few years ago I remember a computer coming in 1st and 2nd.

I wasn't thinking about correspondence but what was the latest large cyborg correspondence tournament?

Re:How much did AlphaGo Zero cost? (2018) by tuxiano on Thursday June 11, 2020 @06:23PM (#23493899)
I don't know the last one but I recall the matches of Hydra chess machine [0] in the early 2000s against GM Adams in tournament condition (5½ to ½ for the machine) and against GM Nickel in correspondence condition (2 to 0 for the human). Both Grandmaster were top players in their relative field so it showed very clearly how the time limitation impacted the competitive results. Nobody in the chess elite would claim that Hydra understood chess better than GM Adams but still he lost resoundigly due to the inevitable mistakes caused by the relatively fast time control.

[0] https://en.wikipedia.org/wiki/Hydra_(chess)

Re:How much did AlphaGo Zero cost? (2018) by JamesBarney on Thursday June 11, 2020 @06:53PM (#23494077)
But wasn't Hydra 2005 ~2800 ELO where as the current best chess engines like Leela Chess Zero or Stockfish are ~4000 ELO?

Just realized that correspondence chess is cyborg chess, I didn't know computers were legal in correspondence chess, but it makes sense now. Reading about it, it sounds like it's less about knowing chess, and more about understanding the applications you're using.

Re:How much did AlphaGo Zero cost? (2018) by tuxiano on Thursday June 11, 2020 @07:32PM (#23494333)
Chess engine ratings are not immediately comparable to human ratings as they are extracted from different pools. Hydra played relatively few games so its rating estimation was somewhat approximate but it was clearly "superhuman" (GM Adams was n°7 in the world and only scored one draw in 6 games). Today Stockfish is awarded a rating of about 3500 [0] with a typical PC hardware but this rating comes from matches between engines and not with humans.

Regarding the argument of "knowing chess", it depends on you definition. I often use this analogy. Correspondence chess is to tournament chess what the marathon is to track running. They require different skills and training but I guarantee to you that a lot of understanding is involved in correspondence chess, possibly more than in tournament chess.

[0] https://ccrl.chessdom.com/ccrl/4040/

Re:How much did AlphaGo Zero cost? (2018) by JamesBarney on Thursday June 11, 2020 @10:22PM (#23495351)
Oh I assumed it required quite a bit of chess knowledge and skill. But I assume what differentiates a good from great player isn't unassisted chess ability. Basically I'm wondering how well do correspondence ratings track with unassisted ratings. It was my understand they don't track really well at the higher levels of correspondence chess.