RTX PRO 6000 ComfyUI CUDA problem

Description: Hello! I am using a Blackwell RTX PRO 6000 GPU on a cloud server (RunPod). The GPU is correctly detected by the system (nvidia-smi works, no errors), the driver and CUDA runtime are installed. However, PyTorch cannot see any available CUDA devices and fails to initialize the GPU. System Details: GPU: NVIDIA RTX PRO 6000 Blackwell Template: ComfyUI RTX 5090 – Python 3.12 Also tried PyTorch 2.2 and 2.8 templates. nvidia-smi output: Driver: 575.51.03 CUDA Version: 12.9 GPU is visible, no active processes, no errors. CUDA toolkit: 12.8 / 12.9 Python: 3.12.10 PyTorch: 2.7.0+cu128 (nightly, installed via pip for CUDA 12.8) LD_LIBRARY_PATH: /usr/local/cuda/lib64 CUDA_VISIBLE_DEVICES: 0 Problem: When running any PyTorch CUDA code, for example: python Copy import torch print(torch.cuda.is_available()) print(torch.cuda.get_device_name(0)) I get: pgsql Copy UserWarning: CUDA initialization: CUDA unknown error - this may be due to an incorrectly set up environment, e.g. changing env variable CUDA_VISIBLE_DEVICES after program start. Setting the available devices to be zero. Is Available: False Device: None The libcuda.so library is found via ctypes and links correctly. nvidia-smi shows the GPU and no active processes. Environment variables appear normal. I have tried: Restarting the server/container. Reinstalling/updating PyTorch (nightly + cu128). Verifying LD_LIBRARY_PATH. Verifying CUDA toolkit and driver versions. Creating a fresh Python venv. Using both the ComfyUI RTX 5090 – Python 3.12 template and the PyTorch 2.2 / 2.8 templates. Question: Is there anything else I can do to make PyTorch detect and initialize the Blackwell GPU? Are there additional libraries, drivers, or configuration steps required for PyTorch to support Blackwell GPUs with CUDA 12.8/12.9? Any advice or troubleshooting steps would be greatly appreciated! Let me know if you want to add more logs or specifics!
No description
7 Replies
Dj
Dj3mo ago
I've seen this report a couple of times now, I think its using the 5090 template with the PRO 6000 that causes it.
Furkan Gözükara SECourses
see this shown on RTX PRO 6000 : https://youtu.be/R02kPf9Y3_w
SECourses
YouTube
Ultimate ComfyUI & SwarmUI on RunPod Tutorial with Addition RTX 500...
If you want to use ComfyUI or SwarmUI with ComfyUI backend on RunPod cloud platform, this is the ultimate tutorial that you will find to step by step install ComfyUI and SwarmUI on RunPod and use each one of them. RunPod is a great platform to scale your AI generation or if you are a GPU poor, rent the very best GPUs and leverage the AI in your ...
AZfilmmaking
AZfilmmakingOP3mo ago
no... it used to work ok, but then after installing some custom nods it just stopped working for all pods
Unknown User
Unknown User3mo ago
Message Not Public
Sign In & Join Server To View
AZfilmmaking
AZfilmmakingOP3mo ago
not helping(
Unknown User
Unknown User3mo ago
Message Not Public
Sign In & Join Server To View
Madiator2011
Madiator20113mo ago
check if node does not downgrade pytorch

Did you find this page helpful?