Re:Terence Tao, "Machine Assisted Proof" [video]
by npunt on Wednesday February 14, 2024 @09:34PM
(#39378457)
verifying/enforcing standards on inputs is not something that only AI unlocks, but LLMs are an example of huge step forward in this kind of work and I was expressing my general enthusiasm for the new tools we now have for these sorts of problems. We can turn relatively subjective content into much more computable semi-objective ratings through simple prompting (e.g. rate X on a scale of 0.0 to 1.0), which is valuable for all sorts of use cases. I'm using it right now for my work.
[ Parent
| on HN ]
Re:Terence Tao, "Machine Assisted Proof" [video]
by itpnotllm on Thursday February 15, 2024 @12:13AM
(#39379360)
Tao explicitly mentions that it is ITPs that unlock this.
The ITPs will keep the LLMs in check, and stop them from bs-ing.
The ITPs unlock massive collaboration.
Re:Terence Tao, "Machine Assisted Proof" [video]
by npunt on Thursday February 15, 2024 @03:20AM
(#39380300)
Um yes ITPs are the unlock for specifically math collaboration. I was referring to other more subjective fields that can also benefit from tech that allows collaboration to scale. LLMs have value for those. For math, LLMs suck.
Re:Terence Tao, "Machine Assisted Proof" [video]
by kaba0 on Thursday February 15, 2024 @03:43AM
(#39380424)
I haven’t yet seen the video, nor am I familiar with the topic - could you please tell me what ITPs are?
Edit: are they interactive theorem provers?
Re:Terence Tao, "Machine Assisted Proof" [video]
by chabulhwi on Thursday February 15, 2024 @11:10PM
(#39393063)
Yes.
Re:Terence Tao, "Machine Assisted Proof" [video]
by pests on Wednesday February 14, 2024 @10:05PM
(#39378636)
May I ask how you are using it or what you are getting it to rate?
Re:Terence Tao, "Machine Assisted Proof" [video]
by npunt on Wednesday February 14, 2024 @11:30PM
(#39379125)
Rating content in a dataset to determine if we need to review it as I'm standardizing a large dataset right now to improve user experience. It's a relatively mundane activity but I think this is tentatively a good method. I've been exploring ways to use it for a bunch of ideas, like distance between ideas and reflecting back to users on how their messages might land with others. I think this idea of accelerating self reflection is a big use case for AI.
Re:Terence Tao, "Machine Assisted Proof" [video]
by maroonblazer on Thursday February 15, 2024 @10:01AM
(#39383443)
This sounds interesting. Are there other examples of this out in the wild? Any plans to blog/write about it? I'm curious to learn more.
Re:Terence Tao, "Machine Assisted Proof" [video]
by npunt on Thursday February 15, 2024 @04:42PM
(#39389380)
I haven't seen any tho I haven't really been looking. Mostly it's messing with prompts and looking at data. I hope to write about it eventually, tho probably in the context of the self reflection use case. I don't think a lot of people are barking up this tree yet and it's important.