Re:Which GPUs to get for deep learning
by nl on Tuesday September 08, 2020 @01:14AM
(#24405389)
There is some truth in this, but it's not the entire picture.
I've thought about it a lot, and talked to lots of really good Kagglers about it. Most of them use multiple machines, rather than having maximum performance in a single machine.
This lets them run multiple completely different experiements at once, and then put extra compute onto the ones that seem good.
That is a big difference to me, when I have to experiment sequentially. The parallelism is more important than absolute speed a lot of the time.
I've thought about it a lot, and talked to lots of really good Kagglers about it. Most of them use multiple machines, rather than having maximum performance in a single machine.
This lets them run multiple completely different experiements at once, and then put extra compute onto the ones that seem good.
That is a big difference to me, when I have to experiment sequentially. The parallelism is more important than absolute speed a lot of the time.