Use pytorch2+cu118 with ADA hardware for 50%+ speedup

Re:Use pytorch2+cu118 with ADA hardware for 50%+ speedup by hospitalJail on Wednesday July 19, 2023 @03:12PM (#36791673)

This was one of the reasons I skipped the 4090.

So few people have the technology that I knew I'd be spending significant time figuring out solutions to problems.

The other reason is that I'd wait a few years and get some 6090 with 4x the VRAM.

[ Parent | on HN ]

Re:Use pytorch2+cu118 with ADA hardware for 50%+ speedup by VHRanger on Wednesday July 19, 2023 @09:45PM (#36795949)

I doubt future generations will up the consumerarket cards past 24gb.

They know it's a bottleneck for LM training and inference, so they'll want to extract value by reserving it for the professional line cards

[ Parent | on HN ]