Re:Show HN: DocsGPT, open-source documentation assistant, fu...
by petilon on Friday February 03, 2023 @08:24PM
(#34650308)
If I take advantage of this for allowing my customers to ask questions about our product documentation, how do I limit questions to questions about my product documentation? I don't want to be paying Open OPI for questions unrelated to my product.
[ Parent
| on HN ]
Re:Show HN: DocsGPT, open-source documentation assistant, fu...
by th3h4mm3r on Friday February 03, 2023 @09:25PM
(#34650728)
This is really a good question.
Could be interesting also which is the best method to provide to GPT a Product documentato and ask question inherents to that and nothing else.
Re:Show HN: DocsGPT, open-source documentation assistant, fu...
by shagie on Friday February 03, 2023 @10:26PM
(#34651107)
One idea would be to use a much cheaper (and faster) classifier to come back with a "yes" or "no" if the question asked is about your product documentation.
Using Ada or Babbage is about 1% of the cost of Davinci (and Curie is 10% the cost of Davinci).
Without any real tuning, this responds quite promptly (and the various tests I've done, correctly):
curl https://api.openai.com/v1/completions \
-H "Content-Type: application/json" \
-H "Authorization: Bearer $OPENAI_API_KEY" \
-d '{
"model": "text-ada-001",
"prompt": "Identify if the following question is about the Olympic Games. Answer with {yes}, {no}, {maybe}.\n\nWhat category is pole vaulting in?",
"temperature": 0.7,
"max_tokens": 38,
"top_p": 1,
"frequency_penalty": 0,
"presence_penalty": 0
}'
Re:Show HN: DocsGPT, open-source documentation assistant, fu...
by bongobingo1 on Friday February 03, 2023 @11:13PM
(#34651436)
> What category is pole vaulting in?
>> Yes
Well, at least you can't say the documentation is out of date.
Re:Show HN: DocsGPT, open-source documentation assistant, fu...
by shagie on Friday February 03, 2023 @11:35PM
(#34651569)
I was just after something simple in its training set to demonstrate the simple classification that could be used as a check before passing the request on to a more expensive fine tuned model.
Re:Show HN: DocsGPT, open-source documentation assistant, fu...
by jesselawson on Friday February 03, 2023 @11:28PM
(#34651534)
Honestly the best comment I've read on here in a long time. Cheers.
Re:Show HN: DocsGPT, open-source documentation assistant, fu...
by keithwhor on Friday February 03, 2023 @11:56PM
(#34651678)
It's way easier and cheaper to use embeddings for these sorts of use cases.