News for hackers. Stuff that matters.
Re:Native JSON Output from GPT-4 by yunyu on Thursday June 15, 2023 @09:29AM (#36340170)
You simply sample tokens starting with the allowed characters and truncate if needed. It’s pretty efficient, there’s an implementation here: https://github.com/1rgs/jsonformer

There are no comments on this comment yet.