Anthropic - Introducing 100K Token Context Windows, Around 75,000 Words

Re:Anthropic - Introducing 100K Token Context Windows, Aroun... by lumost on Thursday May 11, 2023 @02:59PM (#35906717)

I'd be more impressed if it could rewrite Mr. Carraway as an ML engineer in the entire novel. However it's not intrinsically clear that it cannot do this...

It'll be tough to find good benchmarks on long context windows. A human cannot label using 100k tokens of context.

[ Parent | on HN ]

Re:Anthropic - Introducing 100K Token Context Windows, Aroun... by zooch on Thursday May 11, 2023 @03:19PM (#35907051)

My thoughts exactly - rewrite the novel with Mr. Carraway as an ML engineer while maintaining themes/motifs (possible adding new ones too). I'm guessing what's impressive is that these are the first steps towards something like this? Or is it already possible? Someone please correct me here.

[ Parent | on HN ]

Re:Anthropic - Introducing 100K Token Context Windows, Aroun... by gcanyon on Friday May 12, 2023 @01:45AM (#35912379)

Or rewrite The Count of Monte Cristo as a science fiction novel and get The Stars My Destination. Or rewrite Heinlein's Double Star into present-day and get the movie Dave.

[ Parent | on HN ]

Re:Anthropic - Introducing 100K Token Context Windows, Aroun... by saagarjha on Friday May 12, 2023 @02:44AM (#35912803)

Wonder if they’d set it in SF then…

[ Parent | on HN ]