Re:Show HN: DankGPT – Chat with Your Documents
by mutant on Thursday July 27, 2023 @08:12AM
(#36892291)
What happens to documents uploaded? Can you access them? Are they used in later training?
[ Parent
| on HN ]
Re:Show HN: DankGPT – Chat with Your Documents
by rawsh on Thursday July 27, 2023 @12:07PM
(#36895706)
Documents actually never get uploaded! PDF text extraction happens on the client using a web worker and MuPDF compiled to WASM.
1. PDF parsed and chunked on the client
2. Sparse vectors are regenerated for the entire document corpus and the existing vectors are updated
3. Dense vectors are generated for the new text and upserted along with the new sparse values
The original documents stay on your device.
Re:Show HN: DankGPT – Chat with Your Documents
by replwoacause on Saturday July 29, 2023 @07:12PM
(#36925800)
Yeah but what is GPT5?