News for hackers. Stuff that matters.
Re:Native JSON Output from GPT-4 by stavros on Wednesday June 14, 2023 @03:48PM (#36331566)
> Under the hood, functions are injected into the system message in a syntax the model has been trained on. This means functions count against the model's context limit and are billed as input tokens. If running into context limits, we suggest limiting the number of functions or the length of documentation you provide for function parameters.

There are no comments on this comment yet.