Re:Show HN: Unriddle – Create your own GPT-4 on top of any d...
by itsaquicknote on Monday April 03, 2023 @06:11PM
(#35432030)
Hey Naveed, this is a great project well done. I'm curious about the summarisation of longform content. You mention that you're using Langchain - are you using the MapReduce approach for documents that exceed the 32k context window, or some other approach? 600 pages at ~500 words/tokens a page would mean about $20 to mapreduce through a big doc, which seems crazy especially if you iterate on those 'summary' prompts. Or are you using embeddings for everything including summary prompts?
[ Parent
| on HN ]
There are no comments on this comment yet.