News for hackers. Stuff that matters.
Re:$10M AI Mathematical Olympiad Prize by kevinbuzzard on Monday November 27, 2023 @09:57AM (#38432950)
Do we really know for sure that GPT4 has not seen this problem already?
Re:$10M AI Mathematical Olympiad Prize by Davidzheng on Monday November 27, 2023 @10:14AM (#38433169)
It's a good point. The knowledge cut-off says Jan 2022, but in the past there's been reasons to suspect some data after the cut-off is in the model too. There's also the possibility that it has seen the problem somewhere else before Jan 2022.

Nevertheless, I think the more important question is whether GPT-4 is capable of

1) Listing all solutions less than 100

2) Figuring out the commonalities of the solutions

For 1) I have no doubt that the answer is yes based on its coding skills, in fact it is much stronger at coding than this. For 2) my subjective feeling in playing around with it is it's not consistent at similar problems but it can do it sometimes. Maybe in this case it has seen the list of prime powers <100 so it's very easy for it.