News for hackers. Stuff that matters.
Re:ChatGPT's API Is So Good and Cheap, It Makes Most Text Ge... by brownfox on Tuesday March 14, 2023 @06:28AM (#35149453)
Despite the affordable API, complex contexts can result in excessive token usage and potentially exceed the token limit, leading to high costs.

Balancing a responsive and cost-effective system while adopting a large knowledge base remains a challenge.

There are no comments on this comment yet.