I think the issue here is the implied assumption that OpenAI thinks their guardrails will prevent harm to be done from this research _in general_, when in reality it's really just OpenAI's direct involvement that's prevented.
Eventually somebody will use the research to train the model to do whatever they want it to do.
Re:Dall-E 2
by DaedPsyker on Wednesday April 06, 2022 @01:02PM
(#30934731)
Sure but does opening that level of manipulation up to everyone really benefit anyone either? You can't really fight disinformation with more disinformation, that just seems like the seeds of societal breakdown at that point.
Besides that these models are massive. For quite a while the only people even capable of making them will be those with significant means. That will be mostly Governments and Corporations anyway.
Personally, I fear more what corporations or some governments can do with such models than what a random person can do generating Biden images. And without restriction, at least academics could better study these models (including their risks) and we could be better prepared to deal with them.