Re:BigCode Project Releases StarCoder: A 15B Code LLM
by manojlds on Thursday May 04, 2023 @05:14PM
(#35822170)
Aren't GPT-3 etc base LM and ChatGPT the instruction tuned? Or am I wrong?
[ Parent
| on HN ]
Re:BigCode Project Releases StarCoder: A 15B Code LLM
by dpf on Friday May 05, 2023 @06:52AM
(#35827595)
code-davinci-002 is a base LM, and the other 3.5 models (text-davinci-{002,003}, gpt-3.5-turbo, and ChatGPT) use instruction tuning and/or RLHF. Source: https://platform.openai.com/docs/model-index-for-researchers