Re:GPT2, Counting Consciousness and the Curious Hacker
by NPCollapse on Saturday June 08, 2019 @04:41AM
(#20131338)
Big bump to this! After talking to OpenAI and MIRI I have seen that I had misunderstood some of OpenAI's message. I am updating my beliefs accordingly, but taking my time in doing so.
Re:GPT2, Counting Consciousness and the Curious Hacker
by Iv on Saturday June 08, 2019 @05:22AM
(#20131465)
I would have accepted that from a publicly funded research lab. From a group funded by private interests with a very personal views of future and progress, I think it is fair to suspect ulterior motives.
OpenAI decided not to release the full scale version of their model (1.5B), because they were afraid of its potential security implications, in particular in generating fake news.
One thing I believe gets indequate recognition, including in this article, is OpenAI’s stated motivation for their release strategy. From the GPT2 release announcement[1]:
This decision, as well as our discussion of it, is an experiment: while we are not sure that it is the right decision today, we believe that the AI community will eventually need to tackle the issue of publication norms in a thoughtful way in certain research areas. Other disciplines such as biotechnology and cybersecurity have long had active debates about responsible publication in cases with clear misuse potential, and we hope that our experiment will serve as a case study for more nuanced discussions of model and code release decisions in the AI community.
It was, in part, due to direct safety concerns, but it was also to force the conversation about how to handle the release of legitimately dangerous capabilities in the future.
[1] - https://openai.com/blog/better-language-models/