News for hackers. Stuff that matters.

A comment on We need to tell people ChatGPT will lie to them, not debate linguistics. Parent comment

Re:We need to tell people ChatGPT will lie to them, not deba... by antupis on Friday April 07, 2023 @11:27PM (#35490224)
I think good annotation is much harder than obtaining data. But now Reddit, Twitter and Quora will realise what kind goldmine their data is they might close easy access to it.
[ Parent | on HN ]
Re:We need to tell people ChatGPT will lie to them, not deba... by bpodgursky on Saturday April 08, 2023 @12:43AM (#35490600)
None of the GPT models rely on annotated or classified data. It's unsupervised.
[ Parent | on HN ]
Re:We need to tell people ChatGPT will lie to them, not deba... by IanCal on Saturday April 08, 2023 @02:06AM (#35490954)
The final training steps of gpt 3.5 did, and we assume the same for 4. The RLHF step.
[ Parent | on HN ]
Re:We need to tell people ChatGPT will lie to them, not deba... by whimsicalism on Saturday April 08, 2023 @12:21PM (#35494800)
I would say semi-supervised, RLHF is not quite supervised learning.

None of this data is from Reddit, Twitter, etc.

[ Parent | on HN ]
Re:We need to tell people ChatGPT will lie to them, not deba... by wordpad25 on Saturday April 08, 2023 @01:08AM (#35490725)
It’s too easy to scrape them, but even that is already done by many intermediary companies all too happy to resell that data.
[ Parent | on HN ]
Re:We need to tell people ChatGPT will lie to them, not deba... by antupis on Saturday April 08, 2023 @05:04AM (#35491733)
Yup but you still need up to date data and now companies are realising what kinda gold mine random forum posts about nightlife in Glasgow are they will start monetising it and probably try at least kill middle market.
[ Parent | on HN ]