Re:Use pytorch2+cu118 with ADA hardware for 50%+ speedup
by magixx on Wednesday July 19, 2023 @10:41PM
(#36796336)
Anytime I want try out some ML stuff I run into this driver and app version hell. Have you given Docker a try?
I'm considering going this route for portability reasons but don't know if it will actually help.
Re:Use pytorch2+cu118 with ADA hardware for 50%+ speedup
by fnands on Thursday July 20, 2023 @03:30AM
(#36797786)
Docker is good, but I also haven't had any issues with conda.
At least for most ML projects.
Re:Use pytorch2+cu118 with ADA hardware for 50%+ speedup
by alfalfasprout on Thursday July 20, 2023 @05:34PM
(#36807053)
Docker comes with its own problems (especially if you need to mutate the image under the hood). And multi arch quickly becomes a pain. Also much harder to make it truly portable.
We're rolling something around conda+conda-pack and plan to contribute it upstream. Look out for a blog post on HN later this year :)
We've started really investing into a better solution-- always interesting to see just how big a difference getting the right CUDA version for a given build of eg; torch is.