Re:Ask HN: Bypassing GPT-4 8k tokens limit
by vlerenc on Tuesday May 02, 2023 @02:15AM
(#35783981)
What I have automated is actually to find good chunks (in this order: heading, paragraph, sentence, word, non-alphanumeric, mid-word), feed it to gpt-35 (cheap, fast) and give it the previous chunk summaries up front telling it to leverage the context, but not include them in the next chunk summary. Finally, when I have all the chunk summaries, I feed them to gpt-4 for aggregation ("smarter"), telling it not to shorten the overall amount of text. Works decently well.
[ Parent
| on HN ]
There are no comments on this comment yet.