News for hackers. Stuff that matters.

A comment on GPT-2: 6-Month Follow-Up. Parent comment

Re:GPT-2: 6-Month Follow-Up by p1esk on Tuesday August 20, 2019 @07:01PM (#20753120)
My guess is it would be much slower, because GPU processor would wait for data. Compare bandwidth - system RAM to GPU memory (PCIe): 16GBps vs GPU memory to GPU processor: 900GBps.
[ Parent | on HN ]

There are no comments on this comment yet.