Disk reading unacceptably and mind boggingly slow
I thought I had figured out where to put my data:
pay for extra disk space in /
move the data from /workspace (which is a network drive) to / and from there it can be read fast enough.
But today, I tried the same thing in this pod:
RunPod Pytorch 2.1
ID: yuicz8xifys47n
1 x A100 SXM 80GB
16 vCPU 250 GB RAM
runpod/pytorch:2.1.0-py3.10-cuda11.8.0-devel-ubuntu22.04
and the reading speed from / was as horrible as reading from /workspace.
the pod is down now cause obviously i'm not keen to pay for useless machinery
So what are we supposed to do I don't understand how anyone can do ML like this.
pay for extra disk space in /
move the data from /workspace (which is a network drive) to / and from there it can be read fast enough.
But today, I tried the same thing in this pod:
RunPod Pytorch 2.1
ID: yuicz8xifys47n
1 x A100 SXM 80GB
16 vCPU 250 GB RAM
runpod/pytorch:2.1.0-py3.10-cuda11.8.0-devel-ubuntu22.04
and the reading speed from / was as horrible as reading from /workspace.
the pod is down now cause obviously i'm not keen to pay for useless machinery
So what are we supposed to do I don't understand how anyone can do ML like this.
