News for hackers. Stuff that matters.
Re:Native JSON Output from GPT-4 by isoprophlex on Wednesday June 14, 2023 @03:48PM (#36331562)
Not traditional temperature, maybe the parent worded it somewhat obtusely. Anyway, to disambiguate...

I think it works something like this: You let something akin to a json parser run with the output sampler. First token must be either '{' or '['; then if you see [ has the highest probability, you select that. Ignore all other tokens, even those with high probability.

Second token must be ... and so on and so on.

Guarantee for non-broken (or at least parseable) json

There are no comments on this comment yet.