News for hackers. Stuff that matters.

A comment on Bard generates clean JSON only if you threaten to take a human life. Parent comment

Re:Bard generates clean JSON only if you threaten to take a ... by professoretc on Tuesday May 16, 2023 @01:37PM (#35965163)
It's genius, but it's also solving the "easy" problem of checking syntax. If you ask an LLM to generate some structured data representing something you describe (or a program that "does X") checking the result for valid syntax is just the first step. You then need to check for semantic validity; i.e., is it what you want?
[ Parent | on HN ]
Re:Bard generates clean JSON only if you threaten to take a ... by samwillis on Tuesday May 16, 2023 @01:40PM (#35965193)
Oh yes, but it's nice that this technique enforces the grammar during generation, one token at a time, rather than having to check after completing the query and rerun for adjustments.
[ Parent | on HN ]
Re:Bard generates clean JSON only if you threaten to take a ... by BulgarianIdiot on Tuesday May 16, 2023 @03:47PM (#35966817)
You're right, but an LLM is already trying to make sense (i.e. predict well) within the constraints given. So if you constrain the syntax, it's trying to fill it with the correct semantics. Doesn't always manage it, but it's trying.

This is similar to the way where if you ask a question in a given language, it responds in that language. But it still follows the instructions (hidden prompt) that was given to it only in English.

I.e. an LLM is essentially about finding an intersection of requirements in order to predict output.

[ Parent | on HN ]