News for hackers. Stuff that matters.
Re:Anthropic - Introducing 100K Token Context Windows, Aroun... by sebzim4500 on Thursday May 11, 2023 @03:47PM (#35907474)
Everyone serious batches together short prompts so the cost is roughly proportional to the tokens.

There are no comments on this comment yet.