[vhold]

That's what this article is about, they're doing the integration work.

An integration with a very popular tool is already available for use. I've personally tested it and did get a 2x speed up. I didn't have to sign-up for anything.

https://github.com/NVIDIA/Stable-Diffusion-WebUI-TensorRT

[brucethemoose2]

Ugh... I know everyone uses automatic, but I don't really like automatic. Is janky as heck, especially with SDXL, especially if you want to dig into the code and make some manual hacks.

Still, you are right, a native a1111 extensions is quite impressive and exactly the kind of thing Nvidia should pursue.

[diggan]

diffusers also has example usage for TensorRT in the Stable Diffusion context: https://github.com/huggingface/diffusers/blob/85dccab7fd280c...

Seems those particular examples were submitted by NVIDIA employee too: https://github.com/huggingface/diffusers/commit/9d44e2fb6600...

Shouldn't be too hard to adopt to other similar pipelines if you've used diffusers before.

[qiine]

What do you use instead? confyUI ?