A few recruiters have contacted me (a scientist) about doing RLHF and annotation on biomedical tasks. I don’t know if the eventual client was OpenAI or some other LLM provider but they seemed to have money to burn.

I fill in gaps in my contracting with one of these providers, and I know who the ultimate client is, and if you were to list 4-5 options they'd be in there. I've also done work for another company doing work in this space that had at least 4-5 different clients in that space that I can't be sure about. So, yes, while I can't confirm if OpenAI does this, I know one of the big players do, and it's likely most of the other clients are among the top ones...

I've heard rumors that GPT4's training data included "a custom dataset of college textbooks", curated by hand. Nothing beyond that.

https://www.reddit.com/r/mlscaling/comments/14wcy7m/comment/...

just look at what the major labelers are selling - it is exactly that. go to scale ai’s page

Just all their chatgpt customers

In our company we received a linguistic that worked on OpenAI and he was not alone.