News for hackers. Stuff that matters.

A comment on OpenAI's Foundry leaked pricing says a lot. Parent comment

Re:OpenAI's Foundry leaked pricing says a lot by nl on Wednesday March 01, 2023 @08:10AM (#34981978)
From the ChatGTP announcement: "ChatGTP is a sibling model to Instruct GPT"

The paper for that is linked from https://openai.com/research/instruction-following

[ Parent | on HN ]
Re:OpenAI's Foundry leaked pricing says a lot by maleldil on Wednesday March 01, 2023 @09:31AM (#34982784)
The InstructGPT paper only explains the RLHF part of how ChatGPT works. There's reason to believe that isn't enough to achieve ChatGPT's performance and behaviour (e.g. [1]). There are other components that make ChatGPT more powerful, and OpenAPI is not being open about them.

[1] https://yaofu.notion.site/How-does-GPT-Obtain-its-Ability-Tr...

[ Parent | on HN ]
Re:OpenAI's Foundry leaked pricing says a lot by nl on Wednesday March 01, 2023 @06:23PM (#34989795)
I don't think that conclusion is clear at all. Indeed your own link has things they thought were unclear struck and and parts of the InstructGPT paper that explains them inserted.

They do have newer models that aren't generally available that are different though.

[ Parent | on HN ]