No GPU, RO RTX4090 node
Hi, seem like there is an issue with RTX4090 Romanian node. Seem like there is no GPU attached while I pay the regular price (not cpu-only). Maybe not related, but there is something that prevent me to start it with 2 GPU too.
nvidia-smi command returns "Failed to initialize NVML: Driver/library version mismatch" and llama.cpp says "ggml_init_cublas: no CUDA devices found, CUDA will be disabled". No issue with RTX4000 Romanian nodes.
nvidia-smi command returns "Failed to initialize NVML: Driver/library version mismatch" and llama.cpp says "ggml_init_cublas: no CUDA devices found, CUDA will be disabled". No issue with RTX4000 Romanian nodes.
Solution
@f4242 you use ubuntu template that does not have CUDA preinstalled use RunPod Pytorch instead.
