News for hackers. Stuff that matters.
Re:Formalizing the proof of PFR in Lean4 using Blueprint: a ... by t_mann on Tuesday December 05, 2023 @04:27PM (#38537141)
I find it almost scary how casual Terry is about all this. Comparing this to my own humble attempts at graduate math, I feel like a caveman trying to rock a basic wheelbarrow who just gets a visit from a guy in a helicopter. And then that guy is stretching out his hand 'Here, try it out, it's fun, useful and not scary at all'.

It was always clear to me that formalization was the future of math ever since I heard about the four-color theorem. What I did not anticipate, and what Terry seems to take in stride here, was that we'd get an AI that can almost do the job of writing the math as well around the same time as formalization starts to gain traction. The fact that I get to learn about it from the most friendly and humble generational genius is just the cherry on top.

Re:Formalizing the proof of PFR in Lean4 using Blueprint: a ... by rq1 on Tuesday December 05, 2023 @05:19PM (#38537718)
Formalism and its “derivatives” died a long time ago already. Even Hilbert couldn’t do much about it.

That being said, constructive math is still a great idea.

Re:Formalizing the proof of PFR in Lean4 using Blueprint: a ... by t_mann on Tuesday December 05, 2023 @05:31PM (#38537838)
Not sure what you mean by that - what I meant by formalization was to really deduce every statement in a proof from basic axioms and rules. So basically what Prof Tao did in this blog post (except that the hard rote labor has all been abstracted away and handed off to a machine). This kind of formalization is hardly dead I'd say, in fact it's just starting to gain traction in mainstream mathematics, as Prof Tao's recent work shows (if it's not too much work for a Fields medal winner to formalize their proofs, then what excuse do mere mortal mathematicians have?). So what did you mean?

Edit: it's clear that the original four-color proof had nothing to do with this kind of formalization, it was just the debate that got me thinking about it. And tools like Lean4 aren't limited to constructive math afaik.

Re:Formalizing the proof of PFR in Lean4 using Blueprint: a ... by ykonstant on Wednesday December 06, 2023 @01:22AM (#38540968)
>And tools like Lean4 aren't limited to constructive math afaik.

In fact, Lean is strongly geared towards classical logic: most of its tactics assume and use classical logic, especially the excluded middle.

Re:Formalizing the proof of PFR in Lean4 using Blueprint: a ... by staunton on Wednesday December 06, 2023 @02:30AM (#38541311)
> what excuse do mere mortal mathematicians have?

As an ardent proponent of formalizing proofs, I still have to disagree with this framing. Mortal mathematicians don't need any excuse not to formalize their stuff. They rather need a reason to do it. One can give lots of reasons but mathematicians often don't know them or don't agree with them.

An important point is, for example, to understand that most formalizing effort is not primarily motivated by a desire to make sure there are no errors in the math.

Re:Formalizing the proof of PFR in Lean4 using Blueprint: a ... by trevyn on Wednesday December 06, 2023 @04:21AM (#38541907)
>most formalizing effort is not primarily motivated by a desire to make sure there are no errors in the math.

Is this because the proof author is generally confident that the proof is essentially correct?

Re:Formalizing the proof of PFR in Lean4 using Blueprint: a ... by staunton on Wednesday December 06, 2023 @06:58AM (#38542730)
Here's people who are working on Lean's Mathlib discussing this https://leanprover.zulipchat.com/#narrow/stream/270676-lean4...
Re:Formalizing the proof of PFR in Lean4 using Blueprint: a ... by t_mann on Wednesday December 06, 2023 @06:37AM (#38542602)
Mathematicians might not like the insinuation, but the best reason to formalize mathematics is indeed to check its correctness:

https://www.andrew.cmu.edu/user/avigad/meetings/fomm2020/sli...

tl;dr: contradictory stuff even gets published in the likes of Annals of Mathematics, and even top journals are reluctant to retract published proofs that have later been shown to be false (which in itself shouldn't be possible).

Like it or not, the reasons for formalizing mathematics abound, and they have a lot to do with the fact that humans are fallible, but mathematics shouldn't be. The incredibly tedious work of tracking down a proof's correctness to the last axiom is, while overwhelming for humans, exactly the kind of work that classical computers excel at.

Re:Formalizing the proof of PFR in Lean4 using Blueprint: a ... by staunton on Wednesday December 06, 2023 @06:54AM (#38542706)
Of course there's mistakes in papers. It's not that avoiding them isn't the primary motivation for formalization because they don't happen. It's not the primary motivation because mistakes in math papers happening sometimes is OK.

If some result is wrong (as opposed to just details in a proof which could be fixed) and it turns out to be an important result, the mistake is found eventually. This fairly rare occurrence wastes some time for people who maybe used the result and build upon it, but arguably a lot less time than it would take to formalize all papers with existing tools. This might change in the coming decades as formalization becomes easier.

The perspective that this is not the main motivation is also the position of people working on Lean's Mathlib. E.g. Kevin Buzzard has said this at https://leanprover.zulipchat.com/#narrow/stream/270676-lean4...

Re:Formalizing the proof of PFR in Lean4 using Blueprint: a ... by t_mann on Wednesday December 06, 2023 @08:52AM (#38543854)
Well, it appears that Kevin Buzzard hasn't fully made up his mind on this point (from the presentation by him that I linked):

> If my work in pure mathematics is neither useful nor 100 percent guaranteed to be correct, it is surely a waste of time. So I have decided to stop attempting to generate new mathematics, and concentrate instead on carefully checking "known" mathematics on a computer

I also remember him saying sth along the lines that his concern about how much of recent math is reliable being a major inspiration for his initial involvement in an interview (could have been for Quanta Magazine or so), but couldn't find it now, so can't verify.

Re:Formalizing the proof of PFR in Lean4 using Blueprint: a ... by staunton on Wednesday December 06, 2023 @12:41PM (#38547094)
That's actually quite interesting. I hadn't read the entire presentation, to be honest. Maybe it's a case of communicating priorities differently to different stakeholders... After all, it's about what the primary motivation is.

Aside from that, the statement you're quoting is deeply puzzling to me. No work is ever "100% guaranteed to be correct", not even something formally verified by a computer, so that statement is either false, vacuous concerning correctness or he didn't mean it literally... (Maybe 100% really means 99.99999% of the time, or something)

Re:Formalizing the proof of PFR in Lean4 using Blueprint: a ... by t_mann on Wednesday December 06, 2023 @06:25PM (#38550884)
Not clear to me from when the chat statement is, but given that the presentation is from 2020, it would actually be funny if he went from 'this is going to get us 100% certainty' to 'well, we might never be fully sure, but at least it's a cool library'.

Jokes aside, I'm pretty sure he was aware of the limitations at all times, and I'm reading this statement in the context of his examples in the presentation. There's a nice story in a Quanta interview about how he was approached by Peter Scholze to help formalize part of a proof. Scholze had asked whether they'd gone through his recent work, and when he said Yes, Scholze asked whether they'd carefully checked theorem 9.1. Buzzard said no, they didn't have enough time left when they got to chapter 9. And Scholze said, see, that's the problem, is anyone in the world really going to check 9.1? And then there are the stories in the presentation, where entire published proofs are put in question, not because of any direct mistake by the authors, but because of a problem in a lemma they used from previous work. This kind of transitive dependency chain could go down multiple papers, and there's really no guarantee that the later results are salvageable. So it seems to me that formalization would be a great practical tool to mitigate those problems.

And then yes, it's also super cool in its own right (imho), just the fact of collecting the knowledge, and then the related work might also prove useful for formal verification (of hard/software systems), which has practical relevance, and mathlib might also just happen to become a great enabler for developing math-focused AI. So lots of good reasons to do it, but correctness might still be the most direct payoff: Terry Tao has a different blog post about how he found a (fixable) error in a recent proof of his, thanks to Lean. If that happens to him on one of the first occasions where he uses the tool seriously, then we can only guess what's waiting to be fixed (or thrown out) in the whole body of published mathematics.

Re:Formalizing the proof of PFR in Lean4 using Blueprint: a ... by staunton on Thursday December 07, 2023 @05:25PM (#38562683)
I would strongly assume Buzzard believes those two positions to be perfectly compatible and consistent. I'm sure it would be very insightful to hear him explain how they are. Hope someone asks him about it.

> formalization would be a great practical tool to mitigate those problems

Yes, I agree. V. Voevodsky's story is a great example how things can go wrong and I very much admire him for the consequences he took from that.

However, if some mathematician has the goal of advancing a certain field, I don't think you can argue convincingly in 2023 that they should formalize their papers because making extra sure there's no errors is worth the time investment in terms of advancing the field. Again, I expect to see this slowly change.

Re:Formalizing the proof of PFR in Lean4 using Blueprint: a ... by t_mann on Tuesday December 12, 2023 @01:10PM (#38615979)
I'm not saying that starting 2024, journals should only start accepting formalized proofs. I'm well aware that we're probably many thousands of person years away from being able to formalize research involving modern mathematical objects like rough paths or perfectoid spaces. But I do think that we should be moving in that direction. We're halfway through formalizing undergrad education, once we're there we could start including it in graduate courses, and at some point we'll have caught up. Many thousands of years of work divided by many thousands of active grad students maybe isn't prohibitively much. I don't see a reason why in some future, something like Lean couldn't replace something like LaTeX as the de-facto standard language for communicating mathematics. We could build the papers directly from source with docstrings. I don't even think that it would replace peer review, since this considers at least three things, correctness, novelty and relevance, roughly in that order, but it could make it substantially easier by automating much of the first part. And I think it might make the paper writing itself more efficient and enjoyable as well.
Re:Formalizing the proof of PFR in Lean4 using Blueprint: a ... by jhanschoo on Wednesday December 06, 2023 @07:13AM (#38542826)
My experience with copilot in lean is that it's just as useful as in programming. It guesses alright and works well for boilerplate, and structure and syntax, but you need to tune by hand whenever you need to do something significant or clever.