Reddit Is OpenAI’s Moat?

Re:Reddit Is OpenAI’s Moat? by moron4hire on Wednesday June 14, 2023 @10:14AM (#36326305)

Seriously hope OpenAI is stripping all the canned meme replies that go on for hundreds of sub threads and end up as the top comments in threads before they train their models. How would you even do that reliably?

[ Parent | on HN ]

Re:Reddit Is OpenAI’s Moat? by jononor on Wednesday June 14, 2023 @10:27AM (#36326528)

Label data and build a meme classifier? Does not have to be perfect to be useful. But yeah, data curation is probably a huge endeavor at the companies making Language model that are fit for production. Like in practically all applications of Machine Learning.

But the Reinforcement Learning from Human Feedback (RLHF) is also one of the key tools to getting useful outputs.

[ Parent | on HN ]

Re:Reddit Is OpenAI’s Moat? by renewiltord on Wednesday June 14, 2023 @10:36AM (#36326672)

They don't. That's why some tokens from /r/counting mess up their models: SolidGoldMagikarp and " davidj12" or something like that

[ Parent | on HN ]