Re:Google “We Have No Moat, and Neither Does OpenAI”
by user_named on Friday May 05, 2023 @12:43AM
(#35825304)
Turbo and davinci should be equally non-conversational. When you use GhatGPT it also has InstructGPT on top of turbo which is what makes it conversational, together with RLHF.
Re:Google “We Have No Moat, and Neither Does OpenAI”
by cubefox on Friday May 05, 2023 @06:04AM
(#35827209)
No, see neighboring comment.
Re:Google “We Have No Moat, and Neither Does OpenAI”
by cubefox on Friday May 05, 2023 @06:03AM
(#35827198)
> Little correction - 3.5 is not davinci. davinci is 3.0, 3.5-turbo (chatgpt) is a davinci variant that has been tuned and adjusted for chatting and conversation, including all those restrictions.
Little correction of the correction. The base models are:
davinci = GPT-3
code-davinci-002 = GPT-3.5
They do only text completion and do not natively answer to instructions. There are also instruction tuned versions of the latter, e.g. text-davinci-003 and gpt-3.5-turbo-0301 (used in ChatGPT). See
https://platform.openai.com/docs/model-index-for-researchers
Note that code-davinci-002 is no longer available via the OpenAI API, but it is still on Azure. The GPT-4 base model is generally unavailable. Too powerful perhaps.
Little correction - 3.5 is not davinci. davinci is 3.0, 3.5-turbo (chatgpt) is a davinci variant that has been tuned and adjusted for chatting and conversation, including all those restrictions. It is much faster than davinci, way cheaper but as you know, results are… ok
davinci (3.0) is more untuned, slower, more expensive to use, not conversational, but can yield much better quality