Would love more details though from the author!
I will first do some pre-processing on the content and fetch the relevant pieces of content before giving it as a prompt to the API.
Amazing concept btw - would love to see more examples (like a chatbot for a more well-known site).
When the user asks, I try to get the relevant bits and answer the question based on that.
Better to question each document separately and then combine the answers into one last LLM round. Even so, there might be inter-document context that is lost - for example looking at one document that depends on details in another one. Large collections of documents should be loaded up in multiple passes, as the interpretation of a document can change when encountering information in another document. Adding one single piece of information to a collection of documents could slightly change the interpretation of everything, that's how humans incorporate new information.
One interesting application of document-collection based chat bots is finding inconsistencies and contradictions in the source text. If they can do that, they can correctly incorporate new information.
I am the founder of a blogging platform called Feather.so.
People can sign up and create their own blogs using Feather.
Now, with OpenAI releasing their API, they made using AI so accessible for someone like me. So I wanted to add a chatbot functionality to my customer blogs. Basically, I wanted to automatically create a chatbot for each of my customer blogs. That chatbot will be trained on the content on their blog.
When I set out to do this using Open AI, I thought I could do this for every website, not just for my customer blogs.
So I ended up creating an entirely new product called SiteGPT.ai so that it can be used on any website.
The workflow works like this. People login the platform, they enter their website url, and click on a button to start training. Then I start creating a chatbot and train the chatbot will all the content on the website that the user enters.
That chatbot now knows everything about that website. It can answer any questions related to that website.
I have also added a demo chatbot at the bottom right of the sitegpt.ai website. That chatbot is trained on the content of SiteGPT.ai. So it can answer any questions related to its own website.
Please try it out and let me know if you have any feedback. I am also happy to take any other technical questions you may have.
Thanks.