News for hackers. Stuff that matters.

A comment on LLMs up to 4x Faster With Latest NVIDIA Drivers on Windows. Parent comment

Re:LLMs up to 4x Faster With Latest NVIDIA Drivers on Windows by OMGnotThatGuy on Thursday October 19, 2023 @12:29PM (#37945015)
It appears that it's already in there. The trick is that you have to install an extension in some apps to make it work. For instance, there's a TensorRT accelerator extension for Stable Diffusion WebUI that takes advantage of it. I'm installing it right now, though the docs leave a bit to be desired.

https://github.com/NVIDIA/Stable-Diffusion-WebUI-TensorRT

[ Parent | on HN ]

There are no comments on this comment yet.