Can I use Vulkan in Runpod ?
Hi,
I’m trying to use Vulkan inside the following Docker image:
I installed Vulkan tools with:
However, when I run vulkaninfo or any Vulkan program, I get the following error:
I suspect it might be related to the NVIDIA Vulkan driver or ICD not being present inside the container.
Has anyone successfully used Vulkan with this Docker image?
How can I properly configure the NVIDIA Vulkan ICD in this container?
Thanks in advance for any help!
I’m trying to use Vulkan inside the following Docker image:
runpod/pytorch:2.8.0-py3.11-cuda12.8.1-cudnn-devel-ubuntu22.04runpod/pytorch:2.8.0-py3.11-cuda12.8.1-cudnn-devel-ubuntu22.04I installed Vulkan tools with:
apt-get install -y --no-install-recommends vulkan-toolsapt-get install -y --no-install-recommends vulkan-toolsHowever, when I run vulkaninfo or any Vulkan program, I get the following error:
ERROR: [Loader Message] Code 0 : loader_scanned_icd_add: Could not get 'vkCreateInstance' via 'vk_icdGetInstanceProcAddr' for ICD libGLX_nvidia.so.0ERROR: [Loader Message] Code 0 : loader_scanned_icd_add: Could not get 'vkCreateInstance' via 'vk_icdGetInstanceProcAddr' for ICD libGLX_nvidia.so.0I suspect it might be related to the NVIDIA Vulkan driver or ICD not being present inside the container.
Has anyone successfully used Vulkan with this Docker image?
How can I properly configure the NVIDIA Vulkan ICD in this container?
Thanks in advance for any help!
root@88c99df870d9:/app# cat /etc/vulkan/icd.d/nvidia_icd.json
{
"file_format_version" : "1.0.1",
"ICD": {
"library_path": "libGLX_nvidia.so.0",
"api_version" : "1.4.303"
}
}
root@88c99df870d9:/app# dpkg -l | grep vulkan
ii libvulkan1:amd64 1.3.204.1-2 amd64 Vulkan loader library
ii vulkan-tools 1.3.204.0+dfsg1-1 amd64 Miscellaneous Vulkan utilities
root@88c99df870d9:/app# dpkg -l | grep nvidia
root@88c99df870d9:/app# nvidia-smi
Wed Oct 1 01:12:16 2025
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 570.172.08 Driver Version: 570.172.08 CUDA Version: 12.8 |
|-----------------------------------------+------------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+========================+======================|
| 0 NVIDIA RTX A4500 On | 00000000:81:00.0 Off | Off |
| 30% 24C P8 16W / 200W | 1MiB / 20470MiB | 0% Default |
| | | N/A |
+-----------------------------------------+------------------------+----------------------+
+-----------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=========================================================================================|
| No running processes found |
+-----------------------------------------------------------------------------------------+
root@88c99df870d9:/app# vulkaninfo --summary
ERROR: [Loader Message] Code 0 : loader_scanned_icd_add: Could not get 'vkCreateInstance' via 'vk_icdGetInstanceProcAddr' for ICD libGLX_nvidia.so.0
Cannot create Vulkan instance.
This problem is often caused by a faulty installation of the Vulkan driver or attempting to use a GPU that does not support Vulkan.
ERROR at ./vulkaninfo/vulkaninfo.h:649:vkCreateInstance failed with ERROR_INCOMPATIBLE_DRIVER
root@88c99df870d9:/app# root@88c99df870d9:/app# cat /etc/vulkan/icd.d/nvidia_icd.json
{
"file_format_version" : "1.0.1",
"ICD": {
"library_path": "libGLX_nvidia.so.0",
"api_version" : "1.4.303"
}
}
root@88c99df870d9:/app# dpkg -l | grep vulkan
ii libvulkan1:amd64 1.3.204.1-2 amd64 Vulkan loader library
ii vulkan-tools 1.3.204.0+dfsg1-1 amd64 Miscellaneous Vulkan utilities
root@88c99df870d9:/app# dpkg -l | grep nvidia
root@88c99df870d9:/app# nvidia-smi
Wed Oct 1 01:12:16 2025
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 570.172.08 Driver Version: 570.172.08 CUDA Version: 12.8 |
|-----------------------------------------+------------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+========================+======================|
| 0 NVIDIA RTX A4500 On | 00000000:81:00.0 Off | Off |
| 30% 24C P8 16W / 200W | 1MiB / 20470MiB | 0% Default |
| | | N/A |
+-----------------------------------------+------------------------+----------------------+
+-----------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=========================================================================================|
| No running processes found |
+-----------------------------------------------------------------------------------------+
root@88c99df870d9:/app# vulkaninfo --summary
ERROR: [Loader Message] Code 0 : loader_scanned_icd_add: Could not get 'vkCreateInstance' via 'vk_icdGetInstanceProcAddr' for ICD libGLX_nvidia.so.0
Cannot create Vulkan instance.
This problem is often caused by a faulty installation of the Vulkan driver or attempting to use a GPU that does not support Vulkan.
ERROR at ./vulkaninfo/vulkaninfo.h:649:vkCreateInstance failed with ERROR_INCOMPATIBLE_DRIVER
root@88c99df870d9:/app# 
