Downloading models causes the pod to freeze
Hey, not sure if I'm missing something obvious here.
I'm noticing two problems (might have the same cause):
1. I'm trying to download
I'm not doing anything out of the ordinary, I just run
The download is going to the volume disk.
Somewhere mid downloading 2nd out of 6
I lose ssh connection, the RunPod dash shows 100% Memory usage. I can only restart the pod at this point.
2. When I try rsyncing 6gb of files from my local machine to a pod (eg.
I'm using:
- 1xA40, 50GB RAM
-
- 20GB container, 40GB volume (with enough free space before starting the download)
Thanks!
I'm noticing two problems (might have the same cause):
1. I'm trying to download
phi-4I'm not doing anything out of the ordinary, I just run
The download is going to the volume disk.
Somewhere mid downloading 2nd out of 6
.safetensorsI lose ssh connection, the RunPod dash shows 100% Memory usage. I can only restart the pod at this point.
2. When I try rsyncing 6gb of files from my local machine to a pod (eg.
Llama3.2-3B-InstructI'm using:
- 1xA40, 50GB RAM
-
runpod/pytorch:2.4.0-py3.11-cuda12.4.1-devel-ubuntu22.04- 20GB container, 40GB volume (with enough free space before starting the download)
Thanks!
