Increase GPT4's context size by asking it to compress your prompts

Re:Increase GPT4's context size by asking it to compress you... by addisonl on Wednesday April 05, 2023 @10:46AM (#35455160)

We saw an almost 10x jump between GPT-3.5-turbo and gpt-4 (4k to 32k tokens).

[ Parent | on HN ]

Re:Increase GPT4's context size by asking it to compress you... by daydream on Wednesday April 05, 2023 @04:03PM (#35459677)

But are we likely to get another 10x jump with say GPT4.5, and 10x over that with GPT5?

Or is context likely to stay fixed around 32k for the foreseeable future?

That is the question.

[ Parent | on HN ]