News for hackers. Stuff that matters.
Re:OK, I can partly explain the LLM chess weirdness now by falcor84 on Friday November 22, 2024 @10:14AM (#42214448)
I world argue that it's more akin to filtering out the chit-chat with the patient, where the doctor explained things in an imprecise manner, keeping only the formal and valid medical notation
Re:OK, I can partly explain the LLM chess weirdness now by caddemon on Friday November 22, 2024 @10:24AM (#42214534)
There is no legitimate reason to make an illegal move in chess though? There are reasons why a good doctor might intentionally explain things imprecisely to a patient.
Re:OK, I can partly explain the LLM chess weirdness now by hnthrowaway6543 on Friday November 22, 2024 @11:38AM (#42215240)
> There is no legitimate reason to make an illegal move in chess though?

If you make an illegal move and the opponent doesn't notice it, you gain a significant advantage. LLMs just have David Sirlin's "Playing to Win" as part of their training data.

Re:OK, I can partly explain the LLM chess weirdness now by fluoridation on Friday November 22, 2024 @08:30PM (#42218649)
You raise an interesting point. If the filtered out illegal moves were disadvantageous, it could be that if the model had been allowed to make any moves it wanted it would have played to a much worse level than it did.
Re:OK, I can partly explain the LLM chess weirdness now by ses1984 on Friday November 22, 2024 @10:35AM (#42214639)
It’s like the doctor saying, “you have cancer? Oh you don’t? Just kidding. Parkinson’s. Oh it’s not that either? How about common cold?”
Re:OK, I can partly explain the LLM chess weirdness now by falcor84 on Friday November 22, 2024 @10:41AM (#42214685)
Big the difference is that valid bad moves (equivalents of "cancer") were included in the analysis, it's only invalid ones (like "your body is kinda outgrowing itself") that were excluded from the analysis
Re:OK, I can partly explain the LLM chess weirdness now by ses1984 on Friday November 22, 2024 @12:11PM (#42215562)
What makes a chess move invalid is the state of the board. I don’t think moves like “pick up the pawn and throw it across the room” were considered.
Re:OK, I can partly explain the LLM chess weirdness now by toast0 on Friday November 22, 2024 @01:46PM (#42216336)
That's a valid move in Monopoly though. Although it's much prefered to pick up the table and throw it.