Re:Structured Outputs in LLMs
by ninadpathak on Tuesday September 23, 2025 @09:55AM
(#45347092)
In most cases, yes—forcing is common when the grammar dictates a single valid option. It's a fast path. Trickier cases arise if multiple tokens could satisfy the same grammar position, especially with weird tokenizations or BPE merges. Edge cases can trip token selection, but for things like brackets/commas, forced emission usually works flawlessly.
[ Parent
| on HN ]
There are no comments on this comment yet.