Re:Anthropic - Introducing 100K Token Context Windows, Aroun...
by nr2x on Thursday May 11, 2023 @01:48PM
(#35905657)
“POC or GTFO” as the security people say. :-)
Re:Anthropic - Introducing 100K Token Context Windows, Aroun...
by jackson1372 on Thursday May 11, 2023 @06:28PM
(#35909199)
See the pricing PDF[^1] and API docs[^2], but TL;DR:
- Price per token doesn't change compared to regular models
- Existing api users have access now by setting the `model` param to "claude-v1-100k" or "claude-instant-v1-100k"
- New customers can join waitlist at anthropic.com/product
[1]: https://cdn2.assets-servd.host/anthropic-website/production/... [2]: https://console.anthropic.com/docs/api/reference#parameters
Re:Anthropic - Introducing 100K Token Context Windows, Aroun...
by 19h on Friday May 12, 2023 @05:27AM
(#35913870)
We have access and we’re already playing with the 100K model. It’s pretty insane. We‘re about to ditch all of our recursive summarization code.
If you want me to test something for you, lmk and I’ll send it through the api.
Good luck waiting for it.