News for hackers. Stuff that matters.
Re:Show HN: LLM Verified with Monte Carlo Tree Search by outlier99 on Sunday November 12, 2023 @08:54AM (#38240077)
Could this be combined with something like llama.cpp's constraint-based grammar (https://github.com/ggerganov/llama.cpp/blob/master/grammars/...) to always enforce syntactically correct code output?
Re:Show HN: LLM Verified with Monte Carlo Tree Search by namin on Sunday November 12, 2023 @11:16AM (#38241463)
Yes. The verifier check already ensures syntactic correctness, but the search could goes faster if the underlying LLM doesn't generate bad syntax to begin with.