Which GPUs to get for deep learning

Re:Which GPUs to get for deep learning by nl on Monday September 07, 2020 @07:52PM (#24403915)

Just noting that you can (still) do very well on non top-of-the-line cards.

I've won multiple silver Kaggle medals on a 1070. It's true that more power would be helpful, but I feel it's lack of technique (and time!) rather than compute that has held me back from gold medals.

[ Parent | on HN ]

Re:Which GPUs to get for deep learning by edude03 on Tuesday September 08, 2020 @12:40AM (#24405254)

Not disagreeing with you, but from what I've heard, the people who win kaggles are people who can try more things, having a faster card presumably would allow you to try more things because each attempt would take less time.

[ Parent | on HN ]

Re:Which GPUs to get for deep learning by nl on Tuesday September 08, 2020 @01:14AM (#24405389)

There is some truth in this, but it's not the entire picture.

I've thought about it a lot, and talked to lots of really good Kagglers about it. Most of them use multiple machines, rather than having maximum performance in a single machine.

This lets them run multiple completely different experiements at once, and then put extra compute onto the ones that seem good.

That is a big difference to me, when I have to experiment sequentially. The parallelism is more important than absolute speed a lot of the time.

[ Parent | on HN ]