© 2026 Hedgehog Software, LLC

Twitter GitHub Discord

More

Communities Docs About Terms Privacy

Multi Node training with torchrun/slurm - Runpod

Runpod•2y ago•

7 replies

Multi Node training with torchrun/slurm

Has anyone here ever tried multinode on runpod? I am thinking of setting this up but if people have encountered prohibitive network speeds I do not see a reason to.

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

21,202Members

Resources

Recent Announcements

Similar Threads

Was this page helpful?

Similar Threads

Multi-node training with multiple pods sharing same region.

RRunpod / ⛅｜pods

Multi-node without clustering

RRunpod / ⛅｜pods

Compatibility of RTX A6000 for Multi-GPU Training

RRunpod / ⛅｜pods

How to use runpod for multi-machine distributed training?

RRunpod / ⛅｜pods