News for hackers. Stuff that matters.
Re:Show HN: Talk to any ArXiv paper just by changing the URL by evanhu_ on Thursday December 21, 2023 @12:54AM (#38717421)
Thank you! Thanks for pointing that out, since the underlying RAG is rather naive (simple embedding cosine similarity lookup, as opposed to knowledge graph / advanced techniques), I opted to embed both "small" (512 character and below) chunks as well as entire section chunks (embedding the entire introduction) in order to support questions such as "Please summarize the introduction". Since I also use 5 chunks for each context, I suspect this can add up to a massive amount on papers with huge sections.
Re:Show HN: Talk to any ArXiv paper just by changing the URL by gorkish on Friday December 22, 2023 @02:35PM (#38737718)
This is the paper that would reliably trigger context overflows. https://arxiv.org/abs/1811.03116 It otherwise did an admirable job on this brainbender.