News for hackers. Stuff that matters.

A comment on Use pytorch2+cu118 with ADA hardware for 50%+ speedup. Parent comment

Re:Use pytorch2+cu118 with ADA hardware for 50%+ speedup by cheald on Wednesday July 19, 2023 @04:20PM (#36792620)
Is there a trick to getting pytorch+cu121 and xformers to play nicely together? All the xformers packages I can find are torch==2.01+cu118.
[ Parent | on HN ]
Re:Use pytorch2+cu118 with ADA hardware for 50%+ speedup by brucethemoose2 on Wednesday July 19, 2023 @05:33PM (#36793757)
xformers has to match the PyTorch build. For PyTorch nightly, you need to build from source.

xformers still has a small performance benefit (especially at higher resolutions IIRC), but yeah, PyTorch's SDP is good enough.

[ Parent | on HN ]