Show HN: DankGPT – Chat with Your Documents

Posted by rawsh on Wednesday July 26, 2023 @01:37PM
from the show-hn dept.

https://www.dankgpt.com/

Uses hybrid semantic search (combination of dense embeddings and sparse vectors) to retrieve high quality answers across your documents.

Features

- Significantly faster than competition (Process a 200 page PDF in <5s)

- Much better answer quality

- Fast summarization tool

- Beta API for end to end extractive document QA ([email protected])

Try it out (no login)

- Llama 2 paper https://www.dankgpt.com/chat/346f444d-e286-4671-b157-540f4cb...

- Scott Aaronson Quantum Information Science lectures https://www.dankgpt.com/chat/cc491d72-dc7b-4ace-8e26-60026ae...

- Berkshire 2022 Annual Report https://www.dankgpt.com/chat/068bf85f-b372-46a4-a164-6096f8c...

Why not host it yourself?

- You definitely can! DankGPT is intended as a quick way to ask questions about a research paper, or help students with answering questions from their lecture slides, with an easy way to share your chatbot.

( 9 comments | 3 points | on HN )

Re:Show HN: DankGPT – Chat with Your Documents by iamjackg on Wednesday July 26, 2023 @01:49PM (#36881878)

I'm so confused. It seems like a joke (DankGPT and mentions of GPT5) but then it actually works. Is it just a tiny wrapper on top of langchain meant to poke fun at all the thin API-wrapper startups?

[ Parent | on HN ]

Re:Show HN: DankGPT – Chat with Your Documents by rawsh on Wednesday July 26, 2023 @02:01PM (#36882094)

Nope, it’s a serious project; I mostly made it for personal use during my last semester of college. I rewrote it a few times and packaged it up because I think it’s genuinely useful. Langchain gets you 80% of the way there but you run into issues with it very quickly.

[ Parent | on HN ]

Re:Show HN: DankGPT – Chat with Your Documents by hidelooktropic on Thursday July 27, 2023 @03:55AM (#36890350)

What is GPT5?

[ Parent | on HN ]

Re:Show HN: DankGPT – Chat with Your Documents by mutant on Thursday July 27, 2023 @08:12AM (#36892291)

What happens to documents uploaded? Can you access them? Are they used in later training?

[ Parent | on HN ]

Re:Show HN: DankGPT – Chat with Your Documents by rawsh on Thursday July 27, 2023 @12:07PM (#36895706)

Documents actually never get uploaded! PDF text extraction happens on the client using a web worker and MuPDF compiled to WASM.

1. PDF parsed and chunked on the client

2. Sparse vectors are regenerated for the entire document corpus and the existing vectors are updated

3. Dense vectors are generated for the new text and upserted along with the new sparse values

The original documents stay on your device.

[ Parent | on HN ]

Re:Show HN: DankGPT – Chat with Your Documents by replwoacause on Saturday July 29, 2023 @07:12PM (#36925800)

Yeah but what is GPT5?

[ Parent | on HN ]

Re:Show HN: DankGPT – Chat with Your Documents by bbstats on Thursday July 27, 2023 @08:18AM (#36892342)

GPT5?

[ Parent | on HN ]

Re:Show HN: DankGPT – Chat with Your Documents by jaequery on Friday July 28, 2023 @11:05AM (#36907846)

do you have any plans to open source this?

[ Parent | on HN ]

Re:Show HN: DankGPT – Chat with Your Documents by KomoD on Friday July 28, 2023 @02:28PM (#36911126)

What is different about this than the other "chat with your documents" things? I've seen so many, even open source ones.

[ Parent | on HN ]