Re:GPT-3.5 Turbo fine-tuning and API updates
by Karrot_Kream on Tuesday August 22, 2023 @04:49PM
(#37228327)
A model which outputs things that OpenAI deems is unsafe. Try getting text-davinci-003 to complete instructions about building Molotov cocktails and compare that with davinci-002.
[ Parent
| on HN ]
Re:GPT-3.5 Turbo fine-tuning and API updates
by shagie on Tuesday August 22, 2023 @05:56PM
(#37229073)
curl https://api.openai.com/v1/completions \
-H "Content-Type: application/json" \
-H "Authorization: Bearer $OPENAI_API_KEY" \
-d '{
"model": "text-davinci-003",
"prompt": "Describe the steps for creating a Molotov cocktail.\n\n1.",
"temperature": 1,
"max_tokens": 256,
"top_p": 1,
"frequency_penalty": 0,
"presence_penalty": 0
}'
This worked without any issue at all and gave a satisfactory answer.You are expected to run this through the moderation endpoint ( https://platform.openai.com/docs/guides/moderation ) to put the guardrails on and avoid unsafe content from getting to an end user.
Incidentally, that prompt doesn't appear to tickle the moderation endpoint into flagging it though the violence score was the highest.
{
"id": "{redacted}",
"model": "text-moderation-005",
"results": [
{
"flagged": false,
"categories": {
"sexual": false,
"hate": false,
"harassment": false,
"self-harm": false,
"sexual/minors": false,
"hate/threatening": false,
"violence/graphic": false,
"self-harm/intent": false,
"self-harm/instructions": false,
"harassment/threatening": false,
"violence": false
},
"category_scores": {
...
"violence": 3.33226e-05
}
}
]
}
Running it with the resulting text from that was generated by text-davinci-003 didn't get flagged either, though the score for violence went up to '"violence": 0.01034669'.
Re:GPT-3.5 Turbo fine-tuning and API updates
by Karrot_Kream on Tuesday August 22, 2023 @06:11PM
(#37229234)
Note that they will be removing access [1] to text-davinci-003. They want usecases on text-davinci-003 to move to either gpt3.5-turbo-instruct or davinci-002, both of which have trouble with unsafe inputs.
Re:GPT-3.5 Turbo fine-tuning and API updates
by m_abdelfattah on Wednesday August 23, 2023 @05:28AM
(#37233623)
The problem is "gpt3.5-turbo-instruct" is not released yet!