News for hackers. Stuff that matters.
Re:GPT Neo: open-source GPT model, with pretrained 1.3B & 2.... by 6gvONxR4sf7o on Monday March 22, 2021 @01:01PM (#26543487)
People are always claiming to release replicated models by replicating the architecture (or main parts of it) but not testing whether it produces the same level of results. It's maddening, especially when the level of results is so directly measurable (just measure what the paper did, not that it's easy, just concrete).
Re:GPT Neo: open-source GPT model, with pretrained 1.3B & 2.... by stellaathena on Wednesday March 24, 2021 @11:48AM (#26568735)
Our README has comparisons with GPT-2 and GPT-3
Re:GPT Neo: open-source GPT model, with pretrained 1.3B & 2.... by 6gvONxR4sf7o on Wednesday March 24, 2021 @09:21PM (#26575453)
Is there anything on its few shot learning performance? I took few shot learning as the main point of GPT-3. Sorry if I just overlooked it, but I don’t see anything on few shot learning in the readme.