Re:GPT Neo: open-source GPT model, with pretrained 1.3B & 2....
by leogao on Monday March 22, 2021 @12:31AM
(#26536878)
To date, EleutherAI as an "organization" (read: basically a Discord server) has not really attempted any kind of marketing. It has no PR dept, just individuals tweeting about the work that Eleuther does.
Enterprise customers that have no idea about the technical details will just hear about OpenAI's success in this fancy new model and assume that Eleuther can deliver.
I mean, most use cases for "big data" projects that are tiny in comparison with Alphabet's datasets will just work with GPT2 fine, probably.
And Enterprise customers that hear those claims and see some code, maybe some demo, is enough for them to start the consultancy process.
In my opinion that's a policy problem that OpenAI introduced by not requiring the absolute reproducability of both the code and model, and both training and dataset of their models upon release.
Stakes are pretty high in the AI industry, and OpenAI actively influences it. My dream was in the beginning that they are a source of verification, audits and "proof" that models are legit...yet I have the feeling lately that they just buzz around like everyone else.
To this date I haven't seen anyone replicate any of the DNC results, for example.
Anyways, just my two cents on this one.