News for hackers. Stuff that matters.
Re:ChatGPT's Chess Elo is 1400 by babel_ on Friday March 17, 2023 @04:15PM (#35202302)
They probably got them. The problem is that it's difficult to repeat, thanks to temperature, meaning users will get a random spread of outcomes. Today, someone got a legal game. Tomorrow, someone might get a grandmaster level game. But then everyone else trying to repeat or leverage this ends up with worse luck and gets illegal moves or, if they're lucky, moves that make sense in a limited context (such as related to specific gambits etc) but have no role in longer-term play.
Re:ChatGPT's Chess Elo is 1400 by nwienert on Friday March 17, 2023 @04:19PM (#35202342)
I don't think you understand chess if you think you can get lucky and win 10 games. I don't think it even can win one game out of 100 against a 1400 ELO player based on the results I've seen, and I've tried this prompt now a few times.

Only way I can see being wrong is if there are really well known traps it somehow memorized and knew to value, and those players all played into the traps. A 1400 would walk into a variety of gambits. Idk.