News for hackers. Stuff that matters.
Re:OPT: Open Pre-trained Transformer Language Models by gwern on Tuesday May 03, 2022 @03:00PM (#31252127)
I expect they will release the models fully, perhaps even under nonrestrictive licenses. Most researchers aren't too happy about those sort of restrictions, and would know that it vitiates a lot of the value of OPT. They look like they are doing the same sort of thing OA did with GPT-2: a staggered release. (This also has the benefit of not needing all the legal & PR approvals done upfront all at once; and there can be a lot of paperwork there.)

There are no comments on this comment yet.