News for hackers. Stuff that matters.
Re:Introducing Structured Outputs in the API by ejones on Tuesday August 06, 2024 @02:40PM (#41173840)
Similar approach to llama.cpp under the hood - they convert the schema to a grammar. Llama.cpp's implementation was specific to the ggml stack, but what they've built sounds similar to Outlines, which they acknowledged.

There are no comments on this comment yet.