That's against the EULA if OpenAI may want to make a similar model:
> (iii) use the Services to develop foundation models or other large scale models that compete with OpenAI;
https://openai.com/api/policies/terms/
Seems to be about developing models and not just restricting you from training them with it.
They may not need to.
Either everything is fair game for training, or nothing at all is.
I would absolutely bootstrap a model from OpenAI outputs. What are they going to do about it?
Also there are specific techniques for validating that you are model training procedure is directionally correct, such as generating a simulated data set and training your model on that.
The difference is that now, you are more of a code reviewer and editor. You don't have to sit there and figure out the library interface and type out every single line.
Code-completion > Abstraction.
I love these sorts of loopholes. OpenAI is actively trying to curb the potential of their AI. They know how powerful it is. Being able to see a taste of that power is endlessly exciting.