News for hackers. Stuff that matters.

A comment on Use pytorch2+cu118 with ADA hardware for 50%+ speedup. Parent comment

Re:Use pytorch2+cu118 with ADA hardware for 50%+ speedup by voz_ on Wednesday July 19, 2023 @04:29PM (#36792756)
Sorry, no idea what you are talking about.

I am talking about dynamic shapes in torch.compile.

You seem to be talking about software packaging. You also make heavy use of the word "this" without it being clear what "this" is.

[ Parent | on HN ]
Re:Use pytorch2+cu118 with ADA hardware for 50%+ speedup by brucethemoose2 on Wednesday July 19, 2023 @04:46PM (#36793057)
The two most popular stable diffusion UIs (automatic1111 and comfy) have longstanding issues with a few known but poorly documented bugs, like the ADA performance issue.

For instance, the torch.compile thing we are talking about is (last I checked) totally irrelevant for those UIs because they are still using the Stability AI implementation, not diffusers package that Huggingface checks for graph breaks. This may extend to SDXL.

[ Parent | on HN ]