R
RunPod•6mo ago
dhmiller

Slow Download Speed as well - over 6 hours of downloading 4+ GB of files (and still running.).

I did a very large batch of images last night and have been trying to download them for the past hour or two. Looks like the download speed is about 200 -300 kb (that's <kb>) per second. I have a 10 GB broadband connection, so I'm curious if that is an average download time - does it sound correct? Seems slow to me. Others have reported a similar issue... . It would also nice if the time spent downloading was somehow not tied to the type of GPU one is using - I am paying for a 4090 to download now and I would be paying more to download from a higher end card and less to download from a lower end card... Wonder if there is any way to separate those two... UPDATE: Now over 3 HOURS for a couple of GB!! This would be 10 minutes from Google Drive....
13 Replies
flash-singh
flash-singh•6mo ago
try to find gpus closer to the location of where your transfering the data, this has a large impact, if your still concerned about bandwidth, please run a speedtest and report it to us
dhmiller
dhmiller•6mo ago
Thanks. Here's the speedtest - the problem is not on my end. And where does it indicate the location of the GPU? I'm talking about 4 hours now for a few GB. Current speed is c.275kb per second. That's slow. It says I am getting 2014 MBPS download, but that is not possible. Where is the bottleneck? OK _ I am now over 6 hours of downloading 4+ GB of files.
flash-singh
flash-singh•6mo ago
i meant speedtest on the pod side, not your local, you can install speedtest using apt
dhmiller
dhmiller•6mo ago
OK - it has been almost 6 HOURS that I am downloading. This is ridiculous. I need better info as to how exactly to find another way to do this before ALL my credits run out - just wasting money now. I do not care where the issue is and do not wish to trouble shoot for runpod I just need a workaround and a quick reply. runpodctl blew up - did not find the drive I connected to with the notebook. What is another option? At this point. I will run out of credits before all the files are downloaded, so the entire project has been a total waste. already downloaded c. 6 GB RunPod Fast Stable Diffusion ID: s10qphb73woysc
I would appreciate a rapid response... Thank you. Downloaded started this morning. It has been the entire day wasted.
flash-singh
flash-singh•6mo ago
from all the data you have shared, i do not see a speedtest, when you download or upload files, that speed is meaningless due to too many variables in between, speedtest measures speed more accurately by picking the fastest node closest to the server, thats the best way to report an issue with internet ran a speedtest on that server
Retrieving speedtest.net server list...
Selecting best server based on ping...
Hosted by Netprotect (Stockholm) [0.89 km]: 1.143 ms
Testing download speed................................................................................
Download: 1173.26 Mbit/s
Testing upload speed......................................................................................................
Upload: 1322.51 Mbit/s
Retrieving speedtest.net server list...
Selecting best server based on ping...
Hosted by Netprotect (Stockholm) [0.89 km]: 1.143 ms
Testing download speed................................................................................
Download: 1173.26 Mbit/s
Testing upload speed......................................................................................................
Upload: 1322.51 Mbit/s
dhmiller
dhmiller•6mo ago
I have no idea what that data implies except to say that I am now in my 9th hour of downloading the files I created over last night. That is incredibly horrible and I have yet to get any explanation from you as to why this would take so long - and it is only 3/4 finished. Yet I am paying you for the price of a 4090 just to waste the entire day waiting for these files to reach my hard drive. I would appreciate a full refund for the time wasted today and then an explanation of why this would take such an incredilbly long time. This is certainly no fault of my broadband capabilities.
justin
justin•6mo ago
Ik this is late but just to comment in as a community member: 1) They restarted some proxying networks i saw today maybe it will help 2) I recommend, if u are doing a lot of images its better to zip them tgt bc lots of image downloads take a long time just do the issue of copying over servers in general 3) A common thing is try to use the runpodctl https://github.com/runpod/runpodctl Jupyter notebook download if that is how u did it is not the best at downloading
GitHub
GitHub - runpod/runpodctl: 🧰 | RunPod CLI for pod management
🧰 | RunPod CLI for pod management. Contribute to runpod/runpodctl development by creating an account on GitHub.
flash-singh
flash-singh•6mo ago
runpodctl is easy to use but introduces a middle server, best to do direct download or ssh if speed is a concern
justin
justin•6mo ago
Oh that good to know 😮 so runpodctl has a middle server that just forwards data? the cli doesnt just connect directlt to the pod already? interesting
flash-singh
flash-singh•6mo ago
it uses croc, the middle server implements that, we may in near future have croc run on every server so that its always a direct connection to server
ashleyk
ashleyk•6mo ago
You mean use croc instead of runpodctl?
flash-singh
flash-singh•6mo ago
there is no difference between croc and runpodctl, for runpodctl we use our own dedicated servers you can run croc on your local server and use croc utility to point to that and transfer data
ashleyk
ashleyk•6mo ago
Yeah I install croc on most of my templates already, was just wondering whether you were implying that RunPod would do the same with the official templates