News for hackers. Stuff that matters.

A comment on Increase GPT4's context size by asking it to compress your prompts.

Re:Increase GPT4's context size by asking it to compress you... by daydream on Wednesday April 05, 2023 @08:26AM (#35452930)
A promising and potentially useful approach for adding additional context to your prompts.

How likely is it that context size will greatly increase in the coming year or two? Are there fundamental limits, or could we reasonably expect greatly increased context size in the future?

[ Parent | on HN ]
Re:Increase GPT4's context size by asking it to compress you... by addisonl on Wednesday April 05, 2023 @10:46AM (#35455160)
We saw an almost 10x jump between GPT-3.5-turbo and gpt-4 (4k to 32k tokens).
[ Parent | on HN ]
Re:Increase GPT4's context size by asking it to compress you... by daydream on Wednesday April 05, 2023 @04:03PM (#35459677)
But are we likely to get another 10x jump with say GPT4.5, and 10x over that with GPT5?

Or is context likely to stay fixed around 32k for the foreseeable future?

That is the question.

[ Parent | on HN ]