Runpod•2y ago

Comfyui not using GPU, how to fix this?

We are running in instance of Comfyui and it's using CPU and not GPU, using a 4090. How can this be fixed?

Madiator2011•7/1/24, 2:23 PM

Check if your pod is not running in 0 GPU Mode

lightnlenseOP•7/1/24, 2:29 PM

It is running on a 4090.

Jason•7/1/24, 2:34 PM

Yep

Jason•7/1/24, 2:35 PM

What's ur comfyui args

Madiator2011•7/1/24, 2:36 PM

btw I just made better comfy ui template that not breaks on extensions instalation
#Better ComfyUI - CUDA12

digigoblin•7/1/24, 2:38 PM

I don't think that GPU utilization metric is 100% accurate and it also not real-time, better to use

nvidia-smi

nvidia-smi

to check GPU utilization

lightnlenseOP•7/1/24, 10:04 PM

When using the Better Comfy Setup and I connect to port 7777 it says "GPU 0 NVIDIA GeForce RTX 4090"

Jason•7/1/24, 10:04 PM

Yes

Jason•7/1/24, 10:04 PM

thats normal... whats your point

lightnlenseOP•7/1/24, 10:05 PM

I don't know. It's still using the CPU. I'm not sure where to look for the comfy args, other then using the log on Runpod, but there is nothing there that would indicate anything useful.

Jason•7/1/24, 10:05 PM

whats your workflow like

Llightnlense I don't know. It's still using the CPU. I'm not sure where to look for the comfy...

Jason•7/1/24, 10:06 PM

check the comfy docs

Jason•7/1/24, 10:06 PM

Why do you think it's using the cpu??

lightnlenseOP•7/1/24, 10:06 PM

Workflow works fine locally

lightnlenseOP•7/1/24, 10:07 PM

Because I have the crystools Nodepack and it shows it's using the CPU

lightnlenseOP•7/1/24, 10:07 PM

And it takes forever. On my local 4090 it's done in 10 seconds.,

lightnlenseOP•7/1/24, 10:07 PM

Jason•7/1/24, 10:08 PM

create a new pod maybe that pod has a problem?

lightnlenseOP•7/1/24, 10:08 PM

Already tried that

Jason•7/1/24, 10:08 PM

report it to the contact support if it does

digigoblin•7/1/24, 10:09 PM

Do you see anything in the ComfyUI logs?

lightnlenseOP•7/1/24, 10:09 PM

logs.txt43.52KB

digigoblin•7/1/24, 10:11 PM

This looks fine

digigoblin•7/1/24, 10:11 PM

Not sure whats with xformers not being available tho, but that shouldn't cause it not to use GPU.

digigoblin•7/1/24, 10:11 PM

It could impact generation times tho.

digigoblin•7/1/24, 10:12 PM

Does your local have xformers installed?

digigoblin•7/1/24, 10:12 PM

"pytorch version: 2.3.1+cu121" this could be a problem for xformers, there is no compatible xformers for torch 2.3.1.

Llightnlense And it takes forever. On my local 4090 it's done in 10 seconds.,

Jason•7/1/24, 10:14 PM

try your local files to a pod if you want to replicate it

Jason•7/1/24, 10:14 PM

and install the same packages as your local

digigoblin•7/1/24, 10:15 PM

can't install xformers if its installed on local

digigoblin•7/1/24, 10:15 PM

have to reinstall torch

digigoblin•7/1/24, 10:15 PM

only 2.3.0 is compatible with xformers not 2.3.1

lightnlenseOP•7/1/24, 10:15 PM

I don't think my local instance has xformers installed but I'm not sure. it's not in the start up file.

digigoblin•7/1/24, 10:15 PM

activate local venv and then:

pip3 freeze

pip3 freeze

digigoblin•7/1/24, 10:16 PM

then you can compare the versions

digigoblin•7/1/24, 10:16 PM

otherwise also

pip3 show torch
pip3 show xformers

pip3 show torch
pip3 show xformers

Jason•7/1/24, 10:17 PM

wow didn't know pip freeze exists its cool hahahah

lightnlenseOP•7/1/24, 10:17 PM

Once I can find terminal in this new backend you got it

Jason•7/1/24, 10:17 PM

Huh?

Jason•7/1/24, 10:17 PM

which backend did you mean

lightnlenseOP•7/1/24, 10:18 PM

It's not a jupyter notebook so finding the terminal is more difficult. THe port 7777

digigoblin•7/1/24, 10:18 PM

code-server

Jason•7/1/24, 10:19 PM

ohh

Jason•7/1/24, 10:19 PM

try to screenshot the left menu bro

Jason•7/1/24, 10:19 PM

maybe i can help pointing it out

lightnlenseOP•7/1/24, 10:19 PM

Jason•7/1/24, 10:20 PM

No other bottom ones?

Jason•7/1/24, 10:20 PM

i thought there are like 3-4 buttons on the bottom left?

lightnlenseOP•7/1/24, 10:20 PM

Comfyui not using GPU, how to fix this?

Similar Threads

Similar Threads

Similar Threads