News for hackers. Stuff that matters.

A comment on OpenGPT-2: We Replicated GPT-2 Because You Can Too. Parent comment

Re:OpenGPT-2: We Replicated GPT-2 Because You Can Too by happycube on Friday August 23, 2019 @12:26PM (#20779179)
K80 is 2 GPU chips with 12GB, so it's not always as good as one newer/larger GPU. Much more affordable though :)
[ Parent | on HN ]
Re:OpenGPT-2: We Replicated GPT-2 Because You Can Too by p1esk on Friday August 23, 2019 @12:39PM (#20779352)
If I remember correctly K80 memory is actually 24GB, not 2x12GB. This is a pretty important distinction in this context (training GPT-2).

Also, you can get at least 6 K80s for the price of a single RTX Titan (also 24GB). So it would be faster (I don't think RTX Titan is 6x faster than K80) and 6x more memory for the same price. It's a very good deal.

[ Parent | on HN ]