News for hackers. Stuff that matters.

A comment on Exponentially Faster Language Modelling. Parent comment

Re:Exponentially Faster Language Modelling by Geee on Wednesday November 22, 2023 @01:35PM (#38383174)
I am barely understanding, so a stupid question:

Does this also mean that it would be possible to train on parallel GPU-poor setup instead of needing lots of GPU memory / bandwidth on one computer?

[ Parent | on HN ]
Re:Exponentially Faster Language Modelling by dartos on Thursday November 23, 2023 @07:56PM (#38399615)
Probably not. The paper talks about this as an inference time optimization
[ Parent | on HN ]