News for hackers. Stuff that matters.

A comment on OpenGPT-2: We Replicated GPT-2 Because You Can Too. Parent comment

Re:OpenGPT-2: We Replicated GPT-2 Because You Can Too by p1esk on Friday August 23, 2019 @01:14PM (#20779889)
It's $50k per training run. Their main contribution has been finding the optimal hyperparameters, not described in the OpenAI paper. Obviously you need more than one training run to to that.
[ Parent | on HN ]

There are no comments on this comment yet.