Multi-Instance GPU Support on RunPod
Hey,
Last night, I was experimenting with RunPod for the first time, and tried to enable MIG via
I have tried the same thing on Vast.ai and received the same results, however they informed me that they do not officially support said functionality.
With all that, is there a way to get this to work on RunPod? MIG is mentioned in the following blog post: https://www.runpod.io/articles/rent/h100-sxm
Thank you for your help and time.
Last night, I was experimenting with RunPod for the first time, and tried to enable MIG via
nvidia-smi - but it didn’t work. Instead, it threw an ‘insufficient permissions’ error.
I have tried the same thing on Vast.ai and received the same results, however they informed me that they do not officially support said functionality.
With all that, is there a way to get this to work on RunPod? MIG is mentioned in the following blog post: https://www.runpod.io/articles/rent/h100-sxm
Thank you for your help and time.
Instant access to NVIDIA H100 SXM GPUs—ideal for training large language models and high-performance computing—with hourly pricing, global availabilit...
