How to feed content to ChatGPT and make it answer questions about it?

Re:How to feed content to ChatGPT and make it answer questio... by fbrncci on Wednesday May 03, 2023 @01:15AM (#35798302)

Pretty easy, take a look at Langchain tutorials on YouTube. Basically you give it a set of documents, split these into smaller documents and then store these in a vector database and create embeddings (OpenAI, Jina, etc). Then when you interface with OpenAI on GPT-3 or GPT-4, you interface with those documents and embeddings and produce an answer based on the document set (or very near to it).

[ Parent | on HN ]

Re:How to feed content to ChatGPT and make it answer questio... by alexander-g on Wednesday May 03, 2023 @01:51PM (#35805459)

Thank you! It was an eye opener for me. We've been using slightly different approach (at https://jopilot.net) but vector database + langchain allows to process much bigger amount of data.

[ Parent | on HN ]

Re:How to feed content to ChatGPT and make it answer questio... by fbrncci on Thursday May 04, 2023 @01:45AM (#35811648)

No problem! You could probably improve it by fine-tuning GPT models on different categories of documents, prior to doing the vector retrieval from embedding. Fine tuning isn't available for GPT-3-turbo or GPT-4 yet, so I am waiting to try out this hybrid approach for when it does come available.

[ Parent | on HN ]