Runpod

R

Runpod

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

Join

⚡|serverless

⛅|pods

🔧|api-opensource

📡|instant-clusters

🗂|hub

IBGDA feature is available in instant clusters?

I would like to use DeepEP when running DeepSeek-V3 in SGLang, an LLM serving framework. DeepEP requires IBGDA (InfiniBand GPUDirect Async), and I followed the setup instructions by modifying the NVIDIA driver. Is it possible to use the IBGDA feature in instant clusters? https://github.com/deepseek-ai/DeepEP/blob/main/third-party/README.md...
No description

IBGDA for NVIDIA NVSHMEM

I would like to use the DeepEP feature in SGLang, but I believe it requires the following NVIDIA driver configuration. Is it possible to apply this in instant clusters? https://github.com/deepseek-ai/DeepEP/blob/main/third-party/README.md...
No description