Re:Notes on training BERT from scratch on an 8GB consumer GPU
by regularfry on Friday June 02, 2023 @06:31AM
(#36163393)
It wasn't your point, but it was mine. In terms of raw power this should be in range of AMD hardware. Needs porting work, yes, but I have a feeling the hoops ought to be less insane than all that. It's not "recompile with a different library", quite, but if you take a look at the sort of portability work going on in (for instance) llama.cpp you can see reasons for optimism.
[ Parent
| on HN ]
There are no comments on this comment yet.