Re:Native JSON Output from GPT-4
by yunyu on Thursday June 15, 2023 @09:29AM
(#36340170)
You simply sample tokens starting with the allowed characters and truncate if needed. It’s pretty efficient, there’s an implementation here: https://github.com/1rgs/jsonformer
[ Parent
| on HN ]
There are no comments on this comment yet.