News for hackers. Stuff that matters.
Re:Ask HN: Is OpenAI charging me for free tokens? by stephenlf on Tuesday July 29, 2025 @08:10PM (#44729693)
I don’t know how OpenAI prices JSON keys. They likely price it like any other token.

The model described in your paper still uses some amount of inference to generate JSON keys. Plus, each JSON key becomes part of the expanding context window. These keys aren’t free to generate.

There are no comments on this comment yet.