News for hackers. Stuff that matters.

A comment on GPT-Neo – Building a GPT-3-sized model, open source and free. Parent comment

Re:GPT-Neo – Building a GPT-3-sized model, open source and free by jne2356 on Monday January 18, 2021 @03:05PM (#25825959)
OpenAI only trained the full sized GPT-3 once. Hyperparameter sweep was conducted on significantly smaller models (see: https://arxiv.org/abs/2001.08361)
[ Parent | on HN ]

There are no comments on this comment yet.