That's really what's going on here, I think. LLMs aren't that good at math or have deep mathematical insight. They just automate "try shit until something sticks" at scale, which, as it turns out, is a pretty decent way to turn out a bunch of math papers.

LLMs have enabled brute forcing of math in a way that classical computing somehow has not, which is fascinating in and of itself.