Re:OK, I can partly explain the LLM chess weirdness now
by BalinKing on Friday November 22, 2024 @08:20AM
(#42213610)
I feel like you could add “do not capture en passant unless it is the only possible move” to the test without changing what it’s trying to prove—if anything, some small permutation like this might even make it a stronger test of “reasoning capability.” (Personally I’m unconvinced of the utility of this test in the first place, but I think it can be reasonably steelmanned.)
Suppose it tries to capture en passant. How do you know whether that's legal?