Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Don Knuth Plays with ChatGPT. Parent comment
(1) the foundation model (before any RLHF)
(2) RLHF for instruction-following – but not for "safety" or "truthfulness"
(3) RLHF for "safety" and "truthfulness"
But, I don't believe OpenAI gives public access to (1) or (2), only to (3).
I'm also wondering if they maybe they intentionally don't want for it to be easy for people to answer this question.
There are no comments on this comment yet.
(1) the foundation model (before any RLHF)
(2) RLHF for instruction-following – but not for "safety" or "truthfulness"
(3) RLHF for "safety" and "truthfulness"
But, I don't believe OpenAI gives public access to (1) or (2), only to (3).
I'm also wondering if they maybe they intentionally don't want for it to be easy for people to answer this question.