News for hackers. Stuff that matters.
Re:Use pytorch2+cu118 with ADA hardware for 50%+ speedup by boredumb on Wednesday July 19, 2023 @11:36AM (#36788143)
wow if those benchmarks are true that is amazing to read.
Re:Use pytorch2+cu118 with ADA hardware for 50%+ speedup by valine on Wednesday July 19, 2023 @12:06PM (#36788664)
Its true. I've been installing nightly builds of pytorch for months specifically to access this fix. Have been getting 40it/s outputting a 512x512 image on my 4090. Prior to the fix would get around 19it/s.
Re:Use pytorch2+cu118 with ADA hardware for 50%+ speedup by photoGrant on Wednesday July 19, 2023 @12:49PM (#36789442)
Why am I with a 3090 @ 3 it/s?

Am I doing something heavily wrong? All through WSL2

Re:Use pytorch2+cu118 with ADA hardware for 50%+ speedup by valine on Wednesday July 19, 2023 @12:56PM (#36789547)
is/s depends on resolution and other factors like batch size. What are you getting for 512x image?
Re:Use pytorch2+cu118 with ADA hardware for 50%+ speedup by capableweb on Wednesday July 19, 2023 @01:13PM (#36789847)
Also sampler and bunch of other parameters.
Re:Use pytorch2+cu118 with ADA hardware for 50%+ speedup by photoGrant on Wednesday July 19, 2023 @02:01PM (#36790588)
Fair, 12.3. My numbers are with the dev branch and 1024 with the xl model
Re:Use pytorch2+cu118 with ADA hardware for 50%+ speedup by valine on Wednesday July 19, 2023 @02:27PM (#36790997)
Yeah that’ll do it. 3it/s sounds normal then.