News for hackers. Stuff that matters.
Re:Show HN: Unriddle – Create your own GPT-4 on top of any d... by itsaquicknote on Monday April 03, 2023 @06:11PM (#35432030)
Hey Naveed, this is a great project well done. I'm curious about the summarisation of longform content. You mention that you're using Langchain - are you using the MapReduce approach for documents that exceed the 32k context window, or some other approach? 600 pages at ~500 words/tokens a page would mean about $20 to mapreduce through a big doc, which seems crazy especially if you iterate on those 'summary' prompts. Or are you using embeddings for everything including summary prompts?

There are no comments on this comment yet.