I'm trying to find the episode, but on the All in Podcast ~6 months ago, they made comments about how the corporate structure of OpenAI may have been a secret way for Sam Altman to hold a large stake in the company. I don't think this is privacy related, but that there was a shell game with the equity and the non profit status. If they were training on data like that, the board/people at the company would have known.