GPT Neo: open-source GPT model, with pretrained 1.3B & 2.7B weight models

Re:GPT Neo: open-source GPT model, with pretrained 1.3B & 2.... by ShamelessC on Monday March 22, 2021 @08:31PM (#26549410)

I think it would help your PR efforts to let people know that more often. People hear "we are <org_name>" and assume you're, you know, an organization. That comes with some amount of expected bug fixes, documentation, verifying results _before_ you release, etc.

I'm not really sure how much you gain by attracting tons of people to the discord if you finally release and everyone has unreasonable expectations due to the way you advertise the group as a whole.

[ Parent | on HN ]

Re:GPT Neo: open-source GPT model, with pretrained 1.3B & 2.... by stellaathena on Wednesday March 24, 2021 @11:56AM (#26568873)

This'll probably sound silly, but we weren't really expecting much of a response. We've been sitting on these models (they were trained for the Pile paper) for months for no particular reason besides being focused on other things. We figured we'd put it out there in case anyone was interested and then Aran's tweet blew up hard.

[ Parent | on HN ]

Re:GPT Neo: open-source GPT model, with pretrained 1.3B & 2.... by ShamelessC on Thursday March 25, 2021 @03:02AM (#26577229)

Fair enough! I can personally attest to the results being quite impressive now. Fantastic work and apologies for the criticism. It must be a strange situation to get dragged in to all this due to a viral tweet.

[ Parent | on HN ]