Comfyui not using GPU, how to fix this?
We are running in instance of Comfyui and it's using CPU and not GPU, using a 4090. How can this be fixed?
54 Replies
Check if your pod is not running in 0 GPU Mode
It is running on a 4090.
Unknown User•16mo ago
Message Not Public
Sign In & Join Server To View
btw I just made better comfy ui template that not breaks on extensions instalation
#Better ComfyUI - CUDA12
I don't think that GPU utilization metric is 100% accurate and it also not real-time, better to use
nvidia-smi to check GPU utilizationWhen using the Better Comfy Setup and I connect to port 7777 it says "GPU 0 NVIDIA GeForce RTX 4090"
Unknown User•16mo ago
Message Not Public
Sign In & Join Server To View
I don't know. It's still using the CPU. I'm not sure where to look for the comfy args, other then using the log on Runpod, but there is nothing there that would indicate anything useful.
Unknown User•16mo ago
Message Not Public
Sign In & Join Server To View
Workflow works fine locally
Because I have the crystools Nodepack and it shows it's using the CPU
And it takes forever. On my local 4090 it's done in 10 seconds.,
Unknown User•16mo ago
Message Not Public
Sign In & Join Server To View
Already tried that
Unknown User•16mo ago
Message Not Public
Sign In & Join Server To View
Do you see anything in the ComfyUI logs?
This looks fine
Not sure whats with xformers not being available tho, but that shouldn't cause it not to use GPU.
It could impact generation times tho.
Does your local have xformers installed?
"pytorch version: 2.3.1+cu121" this could be a problem for xformers, there is no compatible xformers for torch 2.3.1.
Unknown User•16mo ago
Message Not Public
Sign In & Join Server To View
can't install xformers if its installed on local
have to reinstall torch
only 2.3.0 is compatible with xformers not 2.3.1
I don't think my local instance has xformers installed but I'm not sure. it's not in the start up file.
activate local venv and then:
then you can compare the versions
otherwise also
Unknown User•16mo ago
Message Not Public
Sign In & Join Server To View
Once I can find terminal in this new backend you got it
Unknown User•16mo ago
Message Not Public
Sign In & Join Server To View
It's not a jupyter notebook so finding the terminal is more difficult. THe port 7777
code-server
Unknown User•16mo ago
Message Not Public
Sign In & Join Server To View
Unknown User•16mo ago
Message Not Public
Sign In & Join Server To View
Unknown User•16mo ago
Message Not Public
Sign In & Join Server To View
Unknown User•16mo ago
Message Not Public
Sign In & Join Server To View
Unknown User•16mo ago
Message Not Public
Sign In & Join Server To View
haha I've been trying XD
Menu -> Terminal -> New Terminal
thank youuuu
Unknown User•16mo ago
Message Not Public
Sign In & Join Server To View
I meant menu not files
Unknown User•16mo ago
Message Not Public
Sign In & Join Server To View
torch is 2.3.1
hamburger icon
Unknown User•16mo ago
Message Not Public
Sign In & Join Server To View
I'm trying. It's being obnoxious.
Unknown User•16mo ago
Message Not Public
Sign In & Join Server To View
Trying to use stuff like "pip3 show torch" in the terminal and it's just throwing errors.
Unknown User•16mo ago
Message Not Public
Sign In & Join Server To View
In just the basic terminal in C it's saying it's not found but I'm pretty sure I would have to have it to make comfy work and CUDA to do it's thing.
Unknown User•16mo ago
Message Not Public
Sign In & Join Server To View
New verison of pip is available so I have pip installed.
xformers is not need as pytorch2.0+ has already better memory optimization
btw my template requires cuda 12.1+
Runpod SD ComfyUI, same problem here, GPU Utilization stays at 0%