News for hackers. Stuff that matters.
Re:Show HN: Summate.it – Quickly summarize web articles with... by ggnore7452 on Wednesday January 18, 2023 @04:43AM (#34424973)
there is actually a paper by OpenAI themselves on summarizing long document. essentially, break a longer text into smaller chunks, and run a multi-stage sequential summarization. each chunk uses a trailing window of previous chunk as context, and run this recursively. https://arxiv.org/abs/2109.10862

did a rough implementation myself, works well for articles even 20k tokens. but kind slow because all the additional overlapping runs required. (and more costly)

Re:Show HN: Summate.it – Quickly summarize web articles with... by poma on Tuesday January 24, 2023 @03:41AM (#34501111)
gpt-index can do that automatically