Re:Open source ChatGPT with LLaMA implementation trains 15x ...
by zamalek on Monday February 27, 2023 @01:30PM
(#34960102)
This is not strictly true. GPUs fare better at these tasks for a few reasons:
* The largest contributor is the sheer number of cores.
* The latency between cores and memory.
* FP16 instructions.
128 cores isn't an insignificant fraction of the number of cores on a 1050 (about 600), but CPU cores are individually more powerful. That advantage is potentially difficult to call. The top-end of Genoa has 96/192 cores, and you can slot many of them onto a single board.
AMD is throwing more and more memory into the CPU cache. That's very different to a direct path to GBs of HBM, but at some point the difference in performance might not matter to a novice/dabbler.
* The largest contributor is the sheer number of cores.
* The latency between cores and memory.
* FP16 instructions.
128 cores isn't an insignificant fraction of the number of cores on a 1050 (about 600), but CPU cores are individually more powerful. That advantage is potentially difficult to call. The top-end of Genoa has 96/192 cores, and you can slot many of them onto a single board.
AMD is throwing more and more memory into the CPU cache. That's very different to a direct path to GBs of HBM, but at some point the difference in performance might not matter to a novice/dabbler.
I would say give it a go, see what happens.