Re:Employees Are Feeding Sensitive Biz Data to ChatGPT, Rais...
by cmelbye on Monday March 27, 2023 @04:03PM
(#35331655)
You can retrieve information on demand based on what the user is asking, like this: https://github.com/openai/chatgpt-retrieval-plugin
There is way more context to our business than can fit in 4/8/32k tokens. Even if we could fit the 32k token budget, it would be very expensive to run like this 24/7. Fine-tuning a base model is the only practical/affordable path for us.