News for hackers. Stuff that matters.
Re:Show HN: Chat with your PDF (my first AI side project) by hacky_engineer on Saturday June 03, 2023 @08:36PM (#36181886)
Upload up to 10MB file size? How does that work if the context length is only 4097?
Re:Show HN: Chat with your PDF (my first AI side project) by hacky_engineer on Saturday June 03, 2023 @08:40PM (#36181913)
Also, the signup flow is pretty painful. I have to upload a document, then pay, then go to my email and click on a link, that sends me another link to my email to sign in, then I complete the sign in, and it shows me the order information. And then no where does it let me chat with the robot about my doc...
Re:Show HN: Chat with your PDF (my first AI side project) by alfarez on Sunday June 04, 2023 @04:32AM (#36184022)
Thanks for that feedback.

That UX flow seems strange because the screen flow should just be: 1) upload, 2) pay, 3) chat. It shouldn't have asked you to check your email for anything.

Please feel free to email me at alfarez at gmail dot com if you're still seeing this issue.

As for handling large files, I'm using a popular method of breaking down the doc into small chunks and then just sending the relevant chunks to the AI.

How to pick the "relevant" chunks? Use embeddings and search for the embeddings that are "semantically closest" to the question being asked.

I wrote up an outline of this process here: https://farez.me/how-to-create-a-chatbot-with-openais-api-a-...