News for hackers. Stuff that matters.
Re:Anthropic - Introducing 100K Token Context Windows, Aroun... by flerovium on Thursday May 11, 2023 @01:33PM (#35905447)
It means nothing as long as they don't actually let us test the API.

Good luck waiting for it.

Re:Anthropic - Introducing 100K Token Context Windows, Aroun... by nr2x on Thursday May 11, 2023 @01:48PM (#35905657)
“POC or GTFO” as the security people say. :-)
Re:Anthropic - Introducing 100K Token Context Windows, Aroun... by jackson1372 on Thursday May 11, 2023 @06:28PM (#35909199)
See the pricing PDF[^1] and API docs[^2], but TL;DR:

- Price per token doesn't change compared to regular models

- Existing api users have access now by setting the `model` param to "claude-v1-100k" or "claude-instant-v1-100k"

- New customers can join waitlist at anthropic.com/product

[1]: https://cdn2.assets-servd.host/anthropic-website/production/... [2]: https://console.anthropic.com/docs/api/reference#parameters

Re:Anthropic - Introducing 100K Token Context Windows, Aroun... by 19h on Friday May 12, 2023 @05:27AM (#35913870)
We have access and we’re already playing with the 100K model. It’s pretty insane. We‘re about to ditch all of our recursive summarization code.

If you want me to test something for you, lmk and I’ll send it through the api.

Re:Anthropic - Introducing 100K Token Context Windows, Aroun... by jcims on Friday May 12, 2023 @11:56AM (#35917989)
> We‘re about to ditch all of our recursive summarization code.

I’m in an adjacent industry and this is what I’m looking forward to.