News for hackers. Stuff that matters.
Re:Why are you so sure I'll lose? by yawpitch on Thursday December 14, 2023 @03:26AM (#38639079)
If only chess were a nice allegory for life.
Re:Why are you so sure I'll lose? by cranium on Thursday December 14, 2023 @03:33AM (#38639127)
I remember a quote "Life is like Tetris, stop playing it like chess." I quite like the analogy: you don't have perfect information and what matters is how you deal with what you get.

(After googling, it turned out to be a blog post: https://observer.com/2016/01/your-life-is-tetris-stop-playin...)

Re:Why are you so sure I'll lose? by mitthrowaway2 on Thursday December 14, 2023 @03:43AM (#38639207)
Given the context, what do you think are the relevant differences that affect the validity of the metaphor?
Re:Why are you so sure I'll lose? by yawpitch on Thursday December 14, 2023 @06:33AM (#38640246)
For one, the child can play any number of other games or choose not to play at all; the child can break the board, flip it upside down, fold it in half, introduce the concept of wraparound or flip the way pieces move… the child is free to choose to change the definition and rules of the game… the AI can only, ever, play chess, using only the rules it was given.

The metaphor assumes that life is a game in which there are a finite number of moves and someone is playing to win… chess isn’t remotely a workable metaphor for life.

Re:Why are you so sure I'll lose? by philipswood on Thursday December 14, 2023 @08:14AM (#38640965)
I think his message is targeting a bit deeper than that.

If I had so sum it up (always hard with an allegory):

Developing superhuman AI is a game you can only play once and can expect to lose without ever having a good understanding of how, why or even when you lost.

The suggestion is (like in the movie Wargames) that the best move is not to play.

I'd say the child in the story is mankind. Developing strong AI is the game. It's a game we can expect to lose.

Re:Why are you so sure I'll lose? by yawpitch on Thursday December 14, 2023 @01:37PM (#38645192)
Interesting interpretation, but if true it’s poorly constructed: the child can’t be mankind, as the “you” in the game would then be god and god (not mankind) would have developed the (in the story already extant) AI… and AI that is not, obviously, a strong AGI.

Now, it could be that “you” is Homo Not So Sapiens and the child is Homo Antesingularity… but even then I think you’re stretching it past its breaking points.

Re:Why are you so sure I'll lose? by nvm0n2 on Thursday December 14, 2023 @03:35PM (#38646893)
> Developing superhuman AI is a game you can only play once

But that's not right. Stockfish is superhumanly intelligent at playing chess but it is not the result of a single match between its creator and itself. Humans played chess against computers over and over, for decades, and the "superintelligence" level was seen coming a mile off. Moreover it was never dangerous and those AI techniques never led to a general intelligence.

This is the problem with AI doomers like Yudkowsky. They use rhetorical skill to make clever sounding arguments that contain fallacies, and hope you won't notice. The assumption you can only "play once" is a wild one and thrown in at the end with absolutely nothing earlier in the story supporting it or backing it up.

Re:Why are you so sure I'll lose? by philipswood on Thursday December 14, 2023 @05:06AM (#38639686)
Yeah, maybe poker would be a better choice of game.
Re:Why are you so sure I'll lose? by philipswood on Thursday December 14, 2023 @05:10AM (#38639707)
I find that most fun games are "cartoons" of life.

In any cartoon you choose which features to keep and emphasize and which features to leave out.

Chess is a game of perfect potential knowledge - where the only limit to seeing is your own ability.

What's nice about chess is the "if-I-do-this,-what-happens-in response" kind of thinking it instills.