Stable Diffusion using just 20% of my GPU

[MafiapauCZE]

Hello, i'm using Automatic1111 for like a year, but today i installed new version because i wanted to use PonyXL checkpoints (so far i was using 1.5).
I didn't had any problem till now. If i use 1.5 version, it runs fine, and CUDA is working almost on 100% all the times while generating.
I can render like 6 images txt2img 600x900 on 30 steps in few minutes with 1.5.
But when i'm using the new version, it uses around 20% of CUDA. and render even one image 600x900 on 20 steps takes like 5-6 minutes. (CPU isn't rendering i checked - SD using just like 10% of CPU).

This is screen of task manager while rendering:

i'm not running web-ui with any arguments (i even tried that with arguments that i'm starting with SD 1.5)

set COMMANDLINE_ARGS=--api --no-half-vae --always-batch-cond-uncond --disable-nan-check --opt-split-attention-v1

Everything basicaly works fine, but GPU just can't use it's power to max, so that's probably in settings or something.
Now i need your help because after checking forums, i didn't found any usable answer.

My HW - GPU: MSI Aero 1080 ti 11GB, CPU: i7-3770, 20GB DDR3 RAM, multiple SSDs (1TB, 500GB, 250GB) and 2TB HDD - and every disc got lot of space.

So far i used checkpoints: "DiffusionV6XL_v6StartWithThisOne" and "PONY-3D_SEMI_atomixPonyAnimeXL_v20".
Clip skip set to "2" in settings in WebUI.
Didn't used any VAE because people telling that Pony XL don't need VAE. (so basically VAE that is used is in the checkpoints)
Ngl my generations looks shitty so far. Don't have any embeddings.
Using ADetailer, Tiled Diffusion, Tiled VAE, Dynamic Thresholding (CFG Scale Fix).

That's all i can handle to tell you. Please help guys.
Thx

[MafiapauCZE]

It appears, it was whole caused by extension: "a1111-sd-webui-lycoris".
After disabling it, CUDA usage is again on almost permanent 95%-100%.

Also another solution: VAE is basically what is rendering those pixels - making the whole picture.
I don't know who could be that idiotic to advice someone with that. So i MUST download a sdxl_vae.safetensors
and problem with SD rendering absolute sh*t is gone.

[ItsAtlant]

Hi, I've installed CUDA, but it doesn't seem to utilize the GPU much, even though I've checked the settings to ensure it's enabled.