News for hackers. Stuff that matters.

A comment on We need to tell people ChatGPT will lie to them, not debate linguistics. Parent comment

Re:We need to tell people ChatGPT will lie to them, not deba... by bpodgursky on Saturday April 08, 2023 @12:43AM (#35490600)
None of the GPT models rely on annotated or classified data. It's unsupervised.
[ Parent | on HN ]
Re:We need to tell people ChatGPT will lie to them, not deba... by IanCal on Saturday April 08, 2023 @02:06AM (#35490954)
The final training steps of gpt 3.5 did, and we assume the same for 4. The RLHF step.
[ Parent | on HN ]
Re:We need to tell people ChatGPT will lie to them, not deba... by whimsicalism on Saturday April 08, 2023 @12:21PM (#35494800)
I would say semi-supervised, RLHF is not quite supervised learning.

None of this data is from Reddit, Twitter, etc.

[ Parent | on HN ]