News for hackers. Stuff that matters.
Re:AI solves IMO problems at silver medal level by pclmulqdq on Thursday July 25, 2024 @01:12PM (#41071005)
So if Lean was used to find the answers, where exactly is the AI? A thin wrapper around Lean?
Re:AI solves IMO problems at silver medal level by dooglius on Thursday July 25, 2024 @01:35PM (#41071236)
Lean checks that the proof is valid, it didn't find the proof.
Re:AI solves IMO problems at silver medal level by xrisk on Thursday July 25, 2024 @01:35PM (#41071241)
Lean is just the language, Presumably to drive the AI towards the program (“the proof”)
Re:AI solves IMO problems at silver medal level by pishpash on Thursday July 25, 2024 @01:39PM (#41071272)
The AI is the "solver network", which is the (directed) search over solutions generated by Lean. The AI is in doing an efficient search, I suppose.

I'm also waiting for my answer on the role of the Gemini formalizer, but reading between the lines, it looks like it was only used during training the "solver network", but not used in solving the IMO problems. If so then the hyping is greatly premature, as the hybrid formalizer/solver is the whole novelty of this, but it's not good enough to use end-to-end?

You cannot say AlphaProof learned enough to solve problems if formalization made them easier to solve in the first place! You can say that the "solver network" part learned enough to solve formalized problems better than prior training methods.

Re:AI solves IMO problems at silver medal level by sdenton4 on Thursday July 25, 2024 @04:36PM (#41073101)
Think of problems in NP - you can check the answer efficiently, but finding the answer to check is the hard part... This is basically what we're looking at here: The proof checker can quickly evaluate correctness, but we need something to produce the proof, and that's the hard part.