Re:Use pytorch2+cu118 with ADA hardware for 50%+ speedup
by valine on Wednesday July 19, 2023 @12:06PM
(#36788664)
Its true. I've been installing nightly builds of pytorch for months specifically to access this fix. Have been getting 40it/s outputting a 512x512 image on my 4090. Prior to the fix would get around 19it/s.
[ Parent
| on HN ]
Re:Use pytorch2+cu118 with ADA hardware for 50%+ speedup
by photoGrant on Wednesday July 19, 2023 @12:49PM
(#36789442)
Why am I with a 3090 @ 3 it/s?
Am I doing something heavily wrong? All through WSL2
Re:Use pytorch2+cu118 with ADA hardware for 50%+ speedup
by valine on Wednesday July 19, 2023 @12:56PM
(#36789547)
is/s depends on resolution and other factors like batch size. What are you getting for 512x image?
Re:Use pytorch2+cu118 with ADA hardware for 50%+ speedup
by capableweb on Wednesday July 19, 2023 @01:13PM
(#36789847)
Also sampler and bunch of other parameters.
Re:Use pytorch2+cu118 with ADA hardware for 50%+ speedup
by photoGrant on Wednesday July 19, 2023 @02:01PM
(#36790588)
Fair, 12.3. My numbers are with the dev branch and 1024 with the xl model