News for hackers. Stuff that matters.
Re:OK, I can partly explain the LLM chess weirdness now by krainboltgreene on Friday November 22, 2024 @03:24PM (#42217107)
Yeah like several hundred "Chess IM/GMs react to ChatGPT playing chess" videos on youtube.
Re:OK, I can partly explain the LLM chess weirdness now by sixfiveotwo on Friday November 22, 2024 @05:53PM (#42218027)
Very strange, I cannot spot any specifically saying that ChatGPT cheated or played an illegal move. Can you help?
Re:OK, I can partly explain the LLM chess weirdness now by krainboltgreene on Saturday November 23, 2024 @03:08AM (#42219768)
https://www.youtube.com/watch?v=iWhlrkfJrCQ He has quite a few of these.
Re:OK, I can partly explain the LLM chess weirdness now by sixfiveotwo on Saturday November 23, 2024 @06:51PM (#42224828)
> Yeah like several hundred "Chess IM/GMs react to ChatGPT playing chess" videos on youtube.

If I were to take that sentence literally, I would ask for at least 199 other examples, but I imagine that it was just a figure of speech. Nevertheless, if that's only one player complaining (even several times), can we really conclude that ChatGPT cannot play? Is that enough evidence, or is there something else at work?

I suppose indeed one could, if one expected an LLM to be ready to play out of the box, and that would be a fair criticism.

Re:OK, I can partly explain the LLM chess weirdness now by krainboltgreene on Saturday November 23, 2024 @07:51PM (#42225147)
I really wish I hadn't replied to you.
Re:OK, I can partly explain the LLM chess weirdness now by sixfiveotwo on Tuesday November 26, 2024 @01:22AM (#42243001)
I'm sorry if you feel that way.

I am in no way trying to judge you; rather, I'm trying to get closer to the truth in that matter, and your input is valuable, as it points out a discrepancy wrt TFA, but it is also subject to caution, since it reports the results of only one chess player (right?). Furthermore, both in the case of TFA and this youtuber, we don't have full access to their whole experiments, so we can't reproduce the results, nor can we try to understand why there is a difference.

I might very well be mistaken though, and I am open to criticisms and corrections, of course.

Re:OK, I can partly explain the LLM chess weirdness now by SonOfLilit on Friday November 22, 2024 @05:59PM (#42218061)
But clearly the author got his GPT to play orders of magnitude better than in those videos
Re:OK, I can partly explain the LLM chess weirdness now by krainboltgreene on Saturday November 23, 2024 @03:09AM (#42219769)
In no way is it clear, there's no evidence.