Re:Introducing ChatGPT and Whisper APIs
by juliennakache on Thursday March 02, 2023 @11:13AM
(#34997582)
Interesting. Still pretty limiting but I can see creative ways of working around the limitations. Thanks for sharing!
tl;dr is that you can pre-process each chunk of your database and use embeddings to quickly look up which chunk is most similar to the user's query, and then prepend that chunk to the user's query before giving it to GPT, so that GPT has the relevant context to give an answer.