Re:Introducing Structured Outputs in the API
by ejones on Tuesday August 06, 2024 @02:40PM
(#41173840)
Similar approach to llama.cpp under the hood - they convert the schema to a grammar. Llama.cpp's implementation was specific to the ggml stack, but what they've built sounds similar to Outlines, which they acknowledged.
[ Parent
| on HN ]
There are no comments on this comment yet.