Re:Which GPUs to get for deep learning
by edude03 on Tuesday September 08, 2020 @12:40AM
(#24405254)
Not disagreeing with you, but from what I've heard, the people who win kaggles are people who can try more things, having a faster card presumably would allow you to try more things because each attempt would take less time.
[ Parent
| on HN ]
There is some truth in this, but it's not the entire picture.
I've thought about it a lot, and talked to lots of really good Kagglers about it. Most of them use multiple machines, rather than having maximum performance in a single machine.
This lets them run multiple completely different experiements at once, and then put extra compute onto the ones that seem good.
That is a big difference to me, when I have to experiment sequentially. The parallelism is more important than absolute speed a lot of the time.