P2P transport between gpus issue in EU-SE-1
I've been training LLMs using deepspeed.
However, I've noticed that when the pod is created in the
The only way to prevent this I've found so far is to set the env var
This doesn't always happen when the pod is in
However, I've noticed that when the pod is created in the
EU-SE-1The only way to prevent this I've found so far is to set the env var
NCCL_P2P_DISABLE=1This doesn't always happen when the pod is in
EU-SE-1
