News for hackers. Stuff that matters.

A comment on GPT-2: 6-Month Follow-Up. Parent comment

Re:GPT-2: 6-Month Follow-Up by gwern on Tuesday August 20, 2019 @06:37PM (#20752927)
Ouch! So 11GB is nowhere close to being enough, then. I wonder if even switching to FP16 will be adequate?
[ Parent | on HN ]
Re:GPT-2: 6-Month Follow-Up by newhaus1994 on Tuesday August 20, 2019 @07:09PM (#20753177)
Might be able to get 745M down to work on a single GPU. I'm definitely not using all 24GB, so fp16 might be able to get it down enough.
[ Parent | on HN ]
Re:GPT-2: 6-Month Follow-Up by sdan on Wednesday August 21, 2019 @03:30AM (#20755196)
How would you use fp16 to get it to work on a single GPU? And if you did, what GPU should you use?
[ Parent | on HN ]