News for hackers. Stuff that matters.

A comment on Anthropic - Introducing 100K Token Context Windows, Around 75,000 Words. Parent comment

Re:Anthropic - Introducing 100K Token Context Windows, Aroun... by nr2x on Thursday May 11, 2023 @01:45PM (#35905598)
For me I’d say speed trumps all else. It’s impossible to truly reach scale with the glacial response times you get from current API.
[ Parent | on HN ]
Re:Anthropic - Introducing 100K Token Context Windows, Aroun... by sebzim4500 on Thursday May 11, 2023 @01:48PM (#35905650)
>speed trumps all else

Then use GPT-2

[ Parent | on HN ]
Re:Anthropic - Introducing 100K Token Context Windows, Aroun... by nr2x on Thursday May 11, 2023 @03:06PM (#35906852)
I actually do prefer 3.5-turbo over 4 for many tasks.
[ Parent | on HN ]