> So you're saying OpenAI should collect more personal data?

Or I supposed they could sell their models as packaged software, and the store clerk can check the ID.

The model of standalone packaged software has several benefits to consumers, and privacy is one of those.

OpenAI doesn't collect personal data, more than any other similar service, Midjourney comes to mind, but there are a lot more.

Reinforcement learning is the technique they use, and that means they are feeding the machine good text or image generations, produced by the machine. This means that the data are mushed together in the weights of billions and trillions of other data, and there is no way to get them back.