Re:Show HN: DocsGPT, open-source documentation assistant, fu...
by swalsh on Friday February 03, 2023 @08:18PM
(#34650258)
You could probably ask ChatGPT how to get started with GPT, but I think a lot of people are building apps taking advantage of GPT's Fine Tuning ability. https://platform.openai.com/docs/guides/fine-tuning
Re:Show HN: DocsGPT, open-source documentation assistant, fu...
by petilon on Friday February 03, 2023 @08:24PM
(#34650308)
If I take advantage of this for allowing my customers to ask questions about our product documentation, how do I limit questions to questions about my product documentation? I don't want to be paying Open OPI for questions unrelated to my product.
Re:Show HN: DocsGPT, open-source documentation assistant, fu...
by th3h4mm3r on Friday February 03, 2023 @09:25PM
(#34650728)
This is really a good question.
Could be interesting also which is the best method to provide to GPT a Product documentato and ask question inherents to that and nothing else.
Re:Show HN: DocsGPT, open-source documentation assistant, fu...
by shagie on Friday February 03, 2023 @10:26PM
(#34651107)
One idea would be to use a much cheaper (and faster) classifier to come back with a "yes" or "no" if the question asked is about your product documentation.
Using Ada or Babbage is about 1% of the cost of Davinci (and Curie is 10% the cost of Davinci).
Without any real tuning, this responds quite promptly (and the various tests I've done, correctly):
curl https://api.openai.com/v1/completions \
-H "Content-Type: application/json" \
-H "Authorization: Bearer $OPENAI_API_KEY" \
-d '{
"model": "text-ada-001",
"prompt": "Identify if the following question is about the Olympic Games. Answer with {yes}, {no}, {maybe}.\n\nWhat category is pole vaulting in?",
"temperature": 0.7,
"max_tokens": 38,
"top_p": 1,
"frequency_penalty": 0,
"presence_penalty": 0
}'
Re:Show HN: DocsGPT, open-source documentation assistant, fu...
by bongobingo1 on Friday February 03, 2023 @11:13PM
(#34651436)
> What category is pole vaulting in?
>> Yes
Well, at least you can't say the documentation is out of date.
Re:Show HN: DocsGPT, open-source documentation assistant, fu...
by shagie on Friday February 03, 2023 @11:35PM
(#34651569)
I was just after something simple in its training set to demonstrate the simple classification that could be used as a check before passing the request on to a more expensive fine tuned model.
Re:Show HN: DocsGPT, open-source documentation assistant, fu...
by jesselawson on Friday February 03, 2023 @11:28PM
(#34651534)
Honestly the best comment I've read on here in a long time. Cheers.
Re:Show HN: DocsGPT, open-source documentation assistant, fu...
by keithwhor on Friday February 03, 2023 @11:56PM
(#34651678)
It's way easier and cheaper to use embeddings for these sorts of use cases.
Re:Show HN: DocsGPT, open-source documentation assistant, fu...
by shagie on Friday February 03, 2023 @11:58PM
(#34651686)
It probably is - I just haven't toyed with that part of the system yet.
Re:Show HN: DocsGPT, open-source documentation assistant, fu...
by amrb on Saturday February 04, 2023 @06:37AM
(#34653660)
I'm going to coin the cyber-security finding "Bill exhaustion via open ML prompts".. wonder how long till it's in the Owasp top X
Re:Show HN: DocsGPT, open-source documentation assistant, fu...
by brianjking on Friday February 03, 2023 @09:57PM
(#34650939)
Re:Show HN: DocsGPT, open-source documentation assistant, fu...
by jsf01 on Saturday February 04, 2023 @12:10AM
(#34651741)
Openai has documentation and guides in their blog about how to interface with the GPT API. But in this case, you can also look directly at the source code published here.
Re:Show HN: DocsGPT, open-source documentation assistant, fu...
by danvass on Saturday February 04, 2023 @03:02AM
(#34652638)
If you're looking for a low-code solution, I've written up how we handle this here: https://relevanceai.com/blog/use-all-of-your-blog-posts-and-...
Re:Show HN: DocsGPT, open-source documentation assistant, fu...
by a_vanderbilt on Saturday February 04, 2023 @12:47PM
(#34656378)
This looks like a good way to explore how we could start using AI at our organization. Say we have a PDF of an instruction manual and we'd like to make a workflow that lets us use Ask Relevance. There doesn't seem to be a way to vectorize the content of a PDF. The option isn't presented in the drop down menu. It seems to only offer CSV-related processing, although I selected a PDF as the data type for upload. Am I using it wrong?
Are people asking a question under the hood? Like “explain these 30 code files to me”