UserWarning: CUDA initialization: Unexpected error from cudaGetDeviceCount(). Did you run some cuda
This is a reocurring problem on RunPod.
This time with 3090 -- tried 3 different pods in CA region (can't use US region because it has maintenance soon...).
ID: wmwxn9onlckqus
This time with 3090 -- tried 3 different pods in CA region (can't use US region because it has maintenance soon...).
ID: wmwxn9onlckqus
Solution
You need to use the CUDA filter to select the correct CUDA version. CUDA is not forwards compatible. You need to select a machine that matches the CUDA version of your Docker image. The machine can have a higher version then your Docker image but not a lower version. CUDA is backwards compatible but not forwards compatible.
