[Bug]: Using cpu instead of gpu #561

TheDarkPharoh · 2024-11-04T07:49:49Z

Checklist

The issue exists after disabling all extensions
The issue exists on a clean installation of webui
The issue is caused by an extension, but I believe it is caused by a bug in the webui
The issue exists in the current version of the webui
The issue has not been reported before recently
The issue has been reported before but has not been fixed yet

What happened?

While generating the cpu is being used instead of the gpu

Steps to reproduce the problem

Install webui using zluda following instructions
run webui
check hardware utilization

What should have happened?

It should be using the gpu not the cpu

What browsers do you use to access the UI ?

No response

Sysinfo

I couldnt find the file to download

Console logs

Using VENV: E:\automatic\venv
23:35:40-306823 INFO     Starting SD.Next
23:35:40-309366 INFO     Logger: file="E:\automatic\sdnext.log" level=INFO size=134545 mode=append
23:35:40-310390 INFO     Python: version=3.10.6 platform=Windows bin="E:\automatic\venv\Scripts\python.exe"
                         venv="E:\automatic\venv"
23:35:40-565151 INFO     Version: app=sd.next updated=2024-11-02 hash=65ddc611 branch=master
                         url=https://github.com/vladmandic/automatic/tree/master ui=main
23:35:41-077076 INFO     Platform: arch=AMD64 cpu=AMD64 Family 25 Model 97 Stepping 2, AuthenticAMD system=Windows
                         release=Windows-10-10.0.22631-SP0 python=3.10.6
23:35:41-078612 INFO     Args: []
23:35:41-092843 INFO     CUDA: nVidia toolkit detected
23:35:41-292796 INFO     Verifying requirements
23:35:41-295894 INFO     Verifying packages
23:35:41-352193 INFO     Extensions: disabled=['sdnext-modernui']
23:35:41-353714 INFO     Extensions: enabled=['Lora', 'sd-extension-chainner', 'sd-extension-system-info',
                         'sd-webui-agent-scheduler', 'stable-diffusion-webui-rembg'] extensions-builtin
23:35:41-357808 INFO     Extensions: enabled=['ultimate-upscale-for-automatic1111'] extensions
23:35:41-359332 INFO     Startup: standard
23:35:41-360348 INFO     Verifying submodules
23:35:52-346761 INFO     Extensions enabled: ['Lora', 'sd-extension-chainner', 'sd-extension-system-info',
                         'sd-webui-agent-scheduler', 'stable-diffusion-webui-rembg',
                         'ultimate-upscale-for-automatic1111']
23:35:52-347777 INFO     Verifying requirements
23:35:52-354940 INFO     Command line args: []
23:36:01-245992 INFO     System packages: {'torch': '2.5.1+cu124', 'diffusers': '0.32.0.dev0', 'gradio': '3.43.2',
                         'transformers': '4.46.1', 'accelerate': '1.0.1'}
23:36:02-032136 INFO     Engine: backend=Backend.DIFFUSERS compute=cpu device=cpu attention="Dynamic Attention BMM"
                         mode=no_grad
23:36:02-038767 INFO     Torch parameters: backend=cpu device=cpu config=Auto dtype=torch.bfloat16 vae=torch.bfloat16
                         unet=torch.bfloat16 context=no_grad nohalf=False nohalfvae=False upscast=False
                         deterministic=False test-fp16=True test-bf16=True optimization="Dynamic Attention BMM"
23:36:02-778022 INFO     Device:
23:36:02-998310 INFO     Available VAEs: path="models\VAE" items=0
23:36:02-999847 INFO     Available UNets: path="models\UNET" items=0
23:36:03-000865 INFO     Available TEs: path="models\Text-encoder" items=0
23:36:03-002398 INFO     Disabled extensions: ['sdnext-modernui']
23:36:03-010078 INFO     Available Models: path="models\Stable-diffusion" items=3 time=0.01
23:36:03-190779 INFO     Available Yolo: path="models\yolo" items=6 downloaded=0
23:36:03-277796 INFO     Available LoRAs: path="models\Lora" items=0 folders=2 time=0.00
23:36:04-172628 INFO     Extension: script='extensions-builtin\sd-webui-agent-scheduler\scripts\task_scheduler.py' Using
                         sqlite file: extensions-builtin\sd-webui-agent-scheduler\task_scheduler.sqlite3
23:36:04-215622 INFO     Available Upscalers: items=53 downloaded=2 user=0 time=0.03 types=['None', 'Lanczos',
                         'Nearest', 'ChaiNNer', 'AuraSR', 'ESRGAN', 'LDSR', 'RealESRGAN', 'SCUNet', 'SD', 'SwinIR']
23:36:04-234536 INFO     Available Styles: folder="models\styles" items=288 time=0.02
23:36:04-238083 INFO     UI theme: type=Standard name="black-teal"
23:36:05-057374 INFO     Extension list is empty: refresh required
23:36:06-160112 INFO     Local URL: http://127.0.0.1:7860/
23:36:06-282853 INFO     [AgentScheduler] Task queue is empty
23:36:06-283868 INFO     [AgentScheduler] Registering APIs
23:36:06-367420 INFO     Model metadata saved: file="metadata.json" items=1 time=0.00
23:36:06-369471 INFO     Load model: select="dreamshaper_8 [879db523c3]"
23:36:06-371001 INFO     Autodetect model: detect="Stable Diffusion" class=StableDiffusionPipeline
                         file="E:\automatic\models\Stable-diffusion\dreamshaper_8.safetensors" size=2034MB
Diffusers  4.52it/s ████████ 100% 6/6 00:01 00:00 Loading pipeline components...
23:36:07-868692 INFO     Load network: type=embeddings loaded=0 skipped=0 time=0.00
23:36:08-057594 INFO     Load model: time=1.51 load=1.50 native=512 memory={'ram': {'used': 2.85, 'total': 31.09}}
23:36:08-060134 INFO     Startup time: 15.70 torch=6.94 gradio=1.41 diffusers=0.21 libraries=1.97 samplers=0.07
                         extensions=0.99 detailer=0.18 ui-networks=0.13 ui-txt2img=0.19 ui-img2img=0.07 ui-control=0.11
                         ui-settings=0.23 ui-extensions=0.79 ui-defaults=0.20 launch=0.13 api=0.06 app-started=0.13
                         checkpoint=1.70
23:36:56-396759 INFO     Browser session: user=None client=127.0.0.1 agent=Mozilla/5.0 (Windows NT 10.0; Win64; x64;
                         rv:132.0) Gecko/20100101 Firefox/132.0
23:36:56-420332 INFO     MOTD: N/A
23:37:05-259157 INFO     Base: class=StableDiffusionPipeline
Progress 18.05s/it █████████████████████████████████ 100% 20/20 06:01 00:00 Base
23:43:14-978249 INFO     Save: image="outputs\text\00010-dreamshaper_8-cat.jpg" type=JPEG width=1024 height=1024
                         size=241085
23:43:14-983350 INFO     Processed: images=1 its=0.05 time=369.73 timers={'encode': 0.1, 'args': 0.1, 'pipeline':
                         361.01, 'decode': 8.56, 'post': 0.04} memory={'ram': {'used': 3.48, 'total': 31.09}}

Additional information

Using a ryzen 7800x3d and a radeon 7800xt

lshqqytiger · 2024-11-04T08:11:16Z

Uninstall NVIDIA driver. This repository does not provide backend prioritizing to minimize conflicts with upstream repo.
I can't recognize the commandline argument --use-zluda from your log.

TheDarkPharoh · 2024-11-04T17:33:41Z

I uninstalled the nvidia drivers but its still using the cpu. How do i add the commandline argument? There isnt a space in webui.bat to add it

Using python: Creating VENV: E:\automatic\venv
Using VENV: E:\automatic\venv
08:50:16-286029 INFO 08:50:16-288029 INFO 08:50:16-289028 INFO venv="E:\automatic\venv"
08:50:16-532717 INFO url= 08:50:17-012196 INFO 08:50:17-013196 INFO 08:50:34-608042 INFO 08:51:03-309006 INFO 08:52:18-640808 INFO 08:58:25-603453 INFO extensions=1.93 ui-img2img=0.06 launch=0.20 09:16:04-761190 INFO rv:132.0) Gecko/20100101 09:16:04-887013 INFO MOTD: N/A
09:16:10-911136 INFO Progress 45.19s/it 09:31:27-973096 INFO size=240406
09:31:27-978097 INFO 'pipeline': 31.09}} "C:\Users\esher\AppData\Local\Programs\Python\Python310\python.exe"
Starting SD.Next
Logger: file="E:\automatic\sdnext.log" level=INFO size=164260 mode=append
Python: version=3.10.6 platform=Windows bin="E:\automatic\venv\Scripts\python.exe"
Version: app=sd.next updated=2024-11-02 hash=65ddc611 branch=master
/github.com/vladmandic/automatic/tree/master">https://github.com/vladmandic/automatic/tree/master ui=main
Platform: arch=AMD64 cpu=AMD64 Family 25 Model 97 Stepping 2, AuthenticAMD system=Windows
python=3.10.6
Python: version=3.10.6 platform=Windows bin="E:\automatic\venv\Scripts\python.exe"
OpenVINO: selected
Install: package="openvino==2024.3.0" mode=pip
Install: package="onnxruntime-openvino" mode=pip
Install: package="nncf==2.12.0" mode=pip
Install: package="torch==2.3.1+cpu torchvision==0.18.1+cpu --index-url
nload.pytorch.org/whl/cpu" rel="nofollow">https://download.pytorch.org/whl/cpu" mode=pip
Install: package="onnx" mode=pip
Install: package="onnxruntime" mode=pip
Installing requirements: this may take a while...
Verifying requirements
Install: package="requests==2.32.3" mode=pip
Verifying packages
Install: package="git+https://github.com/openai/CLIP.git" mode=pip
Install: package="open-clip-torch" mode=pip
Startup: standard
Verifying submodules
Extension installed packages: sd-webui-agent-scheduler ['SQLAlchemy==2.0.36',
Extension installed packages: stable-diffusion-webui-rembg ['PyMatting==1.1.12',
ess==4.10.0.84', 'pooch==1.8.2', 'rembg==2.0.59']
Extensions enabled: ['Lora', 'sd-extension-chainner', 'sd-extension-system-info',
'stable-diffusion-webui-rembg',
r-automatic1111']
Installing requirements: this may take a while...
Verifying requirements
Command line args: []
System packages: {'torch': '2.3.1+cpu', 'diffusers': '0.32.0.dev0', 'gradio': '3.43.2',
'4.46.1', 'accelerate': '1.0.1'}
Engine: backend=Backend.DIFFUSERS compute=cpu device=cpu attention="Dynamic Attention BMM"
Torch parameters: backend=cpu device=cpu config=Auto dtype=torch.bfloat16 vae=torch.bfloat16
context=no_grad nohalf=False nohalfvae=False upscast=False
test-fp16=True test-bf16=True optimization="Dynamic Attention BMM"
Available VAEs: path="models\VAE" items=0
Available UNets: path="models\UNET" items=0
Available TEs: path="models\Text-encoder" items=0
Disabled extensions: ['sdnext-modernui']
Available Models: path="models\Stable-diffusion" items=3 time=0.01
Install: package="basicsr" mode=pip
Install: package="gfpgan" mode=pip
Available Yolo: path="models\yolo" items=6 downloaded=0
Available LoRAs: path="models\Lora" items=0 folders=2 time=0.00
Extension: script='extensions-builtin\sd-webui-agent-scheduler\scripts\task_scheduler.py' Using
extensions-builtin\sd-webui-agent-scheduler\task_scheduler.sqlite3
Available Upscalers: items=53 downloaded=2 user=0 time=0.10 types=['None', 'Lanczos',
'ChaiNNer', 'AuraSR', 'ESRGAN', 'LDSR', 'RealESRGAN', 'SCUNet', 'SD', 'SwinIR']
Available Styles: folder="models\styles" items=288 time=1.10
UI theme: type=Standard name="black-teal"
Install: package="clean-fid" mode=pip
Extension list is empty: refresh required
Local URL: http://127.0.0.1:7860/
initialized successfully. Supported frameworks detected: torch, onnx, openvino
OpenVINO: No compatible GPU detected! Using CPU
[AgentScheduler] Task queue is empty
[AgentScheduler] Registering APIs
Load model: select="dreamshaper_8 [879db523c3]"
Autodetect model: detect="Stable Diffusion" class=StableDiffusionPipeline
odels\Stable-diffusion\dreamshaper_8.safetensors" size=2034MB
1.09s/it ████████ 100% 6/6 00:06 00:00 Loading pipeline components...
Load network: type=embeddings loaded=0 skipped=0 time=0.00
Load model: time=7.08 load=6.86 move=0.21 native=512 memory={'ram': {'used': 2.7, 'total':
Startup time: 53.29 torch=14.43 gradio=4.03 diffusers=0.53 libraries=4.20 samplers=0.20
detailer=11.75 upscalers=0.10 networks=1.16 ui-networks=0.16 ui-txt2img=2.25
ui-control=0.11 ui-settings=0.55 ui-extensions=0.70 ui-defaults=0.19
api=0.06 app-started=3.28 checkpoint=7.26
Browser session: user=None client=127.0.0.1 agent=Mozilla/5.0 (Windows NT 10.0; Win64; x64;
Firefox/132.0
Base: class=StableDiffusionPipeline
█████████████████████████████████ 100% 20/20 15:03 00:00 Base
Save: image="outputs\text\00011-dreamshaper_8-cat.jpg" type=JPEG width=1024 height=1024
Processed: images=1 its=0.02 time=917.09 timers={'prepare': 0.03, 'encode': 0.84, 'args': 1.06,
903.87, 'decode': 12.1, 'post': 0.04} memory={'ram': {'used': 3.32, 'total':

lshqqytiger · 2024-11-04T22:48:34Z

You can add arguments in webui-user.bat.

TheDarkPharoh · 2024-11-04T23:53:13Z

There is no webui-user.bat file only a webui.bat

TheDarkPharoh · 2024-11-05T00:43:49Z

Ok I found the webui-user.bat file and added the zluda argument. It gave me this. There is an openvino warning about not being able to find a gpu and so its using a cpu insstead

Using python: "C:\Users\esher\AppData\Local\Programs\Python\Python310\python.exe"
Creating VENV: E:\automatic\venv
Using VENV: E:\automatic\venv
16:32:48-708219 INFO Starting SD.Next
16:32:48-709662 INFO Logger: file="E:\automatic\sdnext.log" level=INFO size=227543 mode=append
16:32:48-711672 INFO Python: version=3.10.6 platform=Windows bin="E:\automatic\venv\Scripts\python.exe"
venv="E:\automatic\venv"
16:32:48-935098 INFO Version: app=sd.next updated=2024-11-02 hash=65ddc611 branch=master
url=https://github.com/vladmandic/automatic/tree/master ui=main
16:32:49-428336 INFO Platform: arch=AMD64 cpu=AMD64 Family 25 Model 97 Stepping 2, AuthenticAMD system=Windows
release=Windows-10-10.0.22631-SP0 python=3.10.6
16:32:49-429336 INFO Args: ['--use-zluda']
16:32:49-444843 INFO Python: version=3.10.6 platform=Windows bin="E:\automatic\venv\Scripts\python.exe"
venv="E:\automatic\venv"
16:32:49-447843 INFO OpenVINO: selected
16:32:49-449843 INFO Install: package="openvino==2024.3.0" mode=pip
16:33:01-655128 INFO Install: package="onnxruntime-openvino" mode=pip
16:33:24-392285 INFO Install: package="nncf==2.12.0" mode=pip
16:34:22-938382 INFO Install: package="torch==2.3.1+cpu torchvision==0.18.1+cpu --index-url
https://download.pytorch.org/whl/cpu" mode=pip
16:35:43-252486 INFO Install: package="onnx" mode=pip
16:36:21-799687 INFO Install: package="onnxruntime" mode=pip
16:36:53-150918 INFO Installing requirements: this may take a while...
16:38:28-194457 INFO Verifying requirements
16:38:28-310970 INFO Install: package="requests==2.32.3" mode=pip
16:38:30-084613 INFO Verifying packages
16:38:30-085614 INFO Install: package="git+https://github.com/openai/CLIP.git" mode=pip
16:38:35-609680 INFO Install: package="open-clip-torch" mode=pip
16:38:37-387096 INFO Startup: standard
16:38:37-388097 INFO Verifying submodules
16:38:46-290449 INFO Extension installed packages: sd-webui-agent-scheduler ['SQLAlchemy==2.0.36',
'greenlet==3.1.1']
16:38:53-962988 INFO Extension installed packages: stable-diffusion-webui-rembg ['PyMatting==1.1.12',
'opencv-python-headless==4.10.0.84', 'pooch==1.8.2', 'rembg==2.0.59']
16:38:54-023011 INFO Extensions enabled: ['Lora', 'sd-extension-chainner', 'sd-extension-system-info',
'sd-webui-agent-scheduler', 'stable-diffusion-webui-rembg',
'ultimate-upscale-for-automatic1111']
16:38:54-024011 INFO Installing requirements: this may take a while...
16:38:54-024011 INFO Verifying requirements
16:38:54-031013 INFO Command line args: ['--use-zluda'] use_zluda=True
16:39:09-797027 INFO System packages: {'torch': '2.3.1+cpu', 'diffusers': '0.32.0.dev0', 'gradio': '3.43.2',
'transformers': '4.46.1', 'accelerate': '1.0.1'}
16:39:11-033373 INFO Engine: backend=Backend.DIFFUSERS compute=cpu device=cpu attention="Dynamic Attention BMM"
mode=no_grad
16:39:11-036374 INFO Torch parameters: backend=cpu device=cpu config=Auto dtype=torch.bfloat16 vae=torch.bfloat16
unet=torch.bfloat16 context=no_grad nohalf=False nohalfvae=False upscast=False
deterministic=False test-fp16=True test-bf16=True optimization="Dynamic Attention BMM"
16:39:11-038373 INFO Device:
16:39:12-422709 INFO Available VAEs: path="models\VAE" items=0
16:39:12-423709 INFO Available UNets: path="models\UNET" items=0
16:39:12-424709 INFO Available TEs: path="models\Text-encoder" items=0
16:39:12-426708 INFO Disabled extensions: ['sdnext-modernui']
16:39:12-431141 INFO Available Models: path="models\Stable-diffusion" items=3 time=0.00
16:39:12-434141 INFO Install: package="basicsr" mode=pip
16:39:19-737968 INFO Install: package="gfpgan" mode=pip
16:39:23-051249 INFO Available Yolo: path="models\yolo" items=6 downloaded=0
16:39:23-135259 INFO Available LoRAs: path="models\Lora" items=0 folders=2 time=0.00
16:39:23-715106 INFO Extension: script='extensions-builtin\sd-webui-agent-scheduler\scripts\task_scheduler.py' Using
sqlite file: extensions-builtin\sd-webui-agent-scheduler\task_scheduler.sqlite3
16:39:23-739067 INFO Available Upscalers: items=53 downloaded=2 user=0 time=0.02 types=['None', 'Lanczos',
'Nearest', 'ChaiNNer', 'AuraSR', 'ESRGAN', 'LDSR', 'RealESRGAN', 'SCUNet', 'SD', 'SwinIR']
16:39:23-757073 INFO Available Styles: folder="models\styles" items=288 time=0.02
16:39:23-761075 INFO UI theme: type=Standard name="black-teal"
16:39:23-844551 INFO Install: package="clean-fid" mode=pip
16:39:26-437720 INFO Extension list is empty: refresh required
16:39:27-442259 INFO Local URL: http://127.0.0.1:7860/
INFO:nncf:NNCF initialized successfully. Supported frameworks detected: torch, onnx, openvino
16:39:30-059505 WARNING OpenVINO: No compatible GPU detected! Using CPU
16:39:30-116212 INFO [AgentScheduler] Task queue is empty
16:39:30-116781 INFO [AgentScheduler] Registering APIs
16:39:30-350815 INFO Load model: select="dreamshaper_8 [879db523c3]"
16:39:30-352376 INFO Autodetect model: detect="Stable Diffusion" class=StableDiffusionPipeline
file="E:\automatic\models\Stable-diffusion\dreamshaper_8.safetensors" size=2034MB
Diffusers 5.99it/s ████████ 100% 6/6 00:01 00:00 Loading pipeline components...
16:39:31-494227 INFO Load network: type=embeddings loaded=0 skipped=0 time=0.00
16:39:31-698252 INFO Load model: time=1.18 load=1.14 native=512 memory={'ram': {'used': 2.7, 'total': 31.09}}
16:39:31-701763 INFO Startup time: 37.67 torch=11.24 gradio=3.70 diffusers=0.36 libraries=3.04 extensions=0.67
detailer=10.62 ui-networks=0.12 ui-txt2img=2.00 ui-img2img=0.06 ui-control=0.11
ui-settings=0.29 ui-extensions=0.69 ui-defaults=0.19 launch=0.14 api=0.06 app-started=2.85
checkpoint=1.35

lshqqytiger · 2024-11-05T01:45:49Z

Try --reinstall-torch.
Also, it is SD.Next, not stable-diffusion-webui-amdgpu. You'd better to ask for help at SD.Next community. (maybe discord)

lshqqytiger added question Further information is requested zluda About ZLUDA navi labels Nov 4, 2024

lshqqytiger added invalid This doesn't seem right and removed question Further information is requested zluda About ZLUDA navi labels Nov 5, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Bug]: Using cpu instead of gpu #561

[Bug]: Using cpu instead of gpu #561

TheDarkPharoh commented Nov 4, 2024

lshqqytiger commented Nov 4, 2024

TheDarkPharoh commented Nov 4, 2024

lshqqytiger commented Nov 4, 2024

TheDarkPharoh commented Nov 4, 2024

TheDarkPharoh commented Nov 5, 2024

lshqqytiger commented Nov 5, 2024

[Bug]: Using cpu instead of gpu #561

[Bug]: Using cpu instead of gpu #561

Comments

TheDarkPharoh commented Nov 4, 2024

Checklist

What happened?

Steps to reproduce the problem

What should have happened?

What browsers do you use to access the UI ?

Sysinfo

Console logs

Additional information

lshqqytiger commented Nov 4, 2024

TheDarkPharoh commented Nov 4, 2024

lshqqytiger commented Nov 4, 2024

TheDarkPharoh commented Nov 4, 2024

TheDarkPharoh commented Nov 5, 2024

lshqqytiger commented Nov 5, 2024