Multi-Instance GPU Support on RunPod
Hey,
Last night, I was experimenting with RunPod for the first time, and tried to enable MIG via
This appears to be due to how virtualisation is implemented, providing a lack of hardware-level control within a pod.
I have tried the same thing on Vast.ai and received the same results, however they informed me that they do not officially support said functionality.
With all that, is there a way to get this to work on RunPod? MIG is mentioned in the following blog post: https://www.runpod.io/articles/rent/h100-sxm
Thank you for your help and time.
Last night, I was experimenting with RunPod for the first time, and tried to enable MIG via
nvidia-smiThis appears to be due to how virtualisation is implemented, providing a lack of hardware-level control within a pod.
I have tried the same thing on Vast.ai and received the same results, however they informed me that they do not officially support said functionality.
With all that, is there a way to get this to work on RunPod? MIG is mentioned in the following blog post: https://www.runpod.io/articles/rent/h100-sxm
Thank you for your help and time.
Instant access to NVIDIA H100 SXM GPUs—ideal for training large language models and high-performance computing—with hourly pricing, global availabilit...
