News for hackers. Stuff that matters.
Re:Grammars of Formal Uncertainty by pizza on Tuesday May 27, 2025 @12:03AM (#44103865)
This seems like the type of work that, whether or not it itself is profound (which I believe it seems it is), will accelerate the forthbringing of derivative works that will definitely be profound.
Re:Grammars of Formal Uncertainty by molmoai on Tuesday May 27, 2025 @06:22AM (#44105540)
Elegant indeed. Bridges the formal and probabilistic paradigms
Re:Grammars of Formal Uncertainty by molmoai on Tuesday May 27, 2025 @06:18AM (#44105525)
Brings out a refreshing perspective to LLM guarantees. Very good work.
Re:Grammars of Formal Uncertainty by lou1306 on Wednesday May 28, 2025 @03:56AM (#44113690)
I do not see much backing to the claim LLMs can "democratize" formal methods, given that their specifications likely still have to be proof-read by an actual expert. There's also the issue that plain assertion-checking will only take you so far: formal specifications typically need to account for the passing of time, and then the tailoring of the verification platform to the system, rather than property specification, is what usually takes the most effort.

But the general approach to uncertainty and connections to OoD detection do sound interesting.

Re:Grammars of Formal Uncertainty by phoenixrecruit on Saturday May 31, 2025 @02:32PM (#44146121)
Great breakdown—PCFG-based uncertainty metrics seem like exactly what we need to make LLM-SMT pipelines robust and reliable!