Re:GPT-3.5 Turbo fine-tuning and API updates
by J_Shelby_J on Wednesday August 23, 2023 @01:32PM
(#37239400)
That's actually something that I think is a next step.
a) run locally through a web ui b) run with a local vectorstore
From my perspective of someone using it as a bot that runs in a container using a cloud based vector store makes a lot of sense, but yeah that's really good feedback and not something I considered. Hrmmm. Ok let me get a look at some local vectorstores.
I'm currently trying to build a hobby virtual assistant, and it looks like RAG does need some nuance to implement correctly (from what you said). A library that does all of what you mentioned would take a lot of work out of it.