News for hackers. Stuff that matters.
Re:Structured Outputs in LLMs by esafak on Tuesday September 23, 2025 @08:57AM (#45346405)
When you say custom grammar, do you mean something other than a JSON schema, because they support that?
Re:Structured Outputs in LLMs by thrance on Tuesday September 23, 2025 @10:49AM (#45347864)
I mean, most don't? I know you can provide a pseudo-EBNF grammar to llama.cpp but, for example, none of Anthropic, Azure, Bedrock, Mistral or Gemini allow us the same.