Extremely slow upload to HuggingFace
For the past 10 hours or so I've had issues uploading to HuggingFace on my pod (jhw1d9hmjb8d3v).
speedtest-cli shows acceptable speeds, but specifically uploading to HuggingFace goes below 1MB/s often.5 Replies
Unknown User•11mo ago
Message Not Public
Sign In & Join Server To View
hf_transfer was installed and enabled. I uploaded everything to a S3 bucket and uploaded to HF from another pod. It's quite annoying though, because this can become very costly very quickly.
Unknown User•11mo ago
Message Not Public
Sign In & Join Server To View
@nikolai
Escalated To Zendesk
The thread has been escalated to Zendesk!
No, it was a "local" persistent volume. Uploading to S3 was fast in the end, but to HF was very problematic.