Runpod•13mo ago

"Something went wrong!" when trying to sync with Google Cloud Storage

Hello. Just trying to sync my pod's internal volume with google colud storage and getting popup with that error. No matter which data I enter - correct or incorrect, it happens. I'm using community cloud pod with runpod/pytorch:2.0.1-py3.10-rocm5.7-ubuntu22.04 image.

yhlong00000•12/20/24, 9:36 PM

probably wrong credential, path and etc, check this doc:
https://docs.runpod.io/pods/configuration/export-data#google-cloud-storage

Export data | RunPod Documentation

Export RunPod data to various cloud providers, including Amazon S3, Google Cloud Storage, Microsoft Azure Blob Storage, Backblaze B2 Cloud Storage, and Dropbox, with secure key and access token management.

Yyhlong00000 probably wrong credential, path and etc, check this doc: https://docs.runpod.io/...

CaiOP•12/20/24, 10:49 PM

Already read this. I think maybe problem is with JSON key; didn't understand clearly which format it should follow (this is my first time integrating google cloud with... anything). Should it be a full JSON value like {"type": ..., "project_id": ..., "private_key": ..., ...}{"type": ..., "project_id": ..., "private_key": ..., ...} or only "private_key" field's value? If the latter, should I convert newlines to something different?

yhlong00000•12/21/24, 4:03 AM

Should be full JSON

Yyhlong00000 Should be full JSON

CaiOP•12/21/24, 7:35 AM

That's was the first thing I tried; getting that error anyway.

yhlong00000•12/21/24, 1:25 PM

Behind the scenes, the system uses rclone for copy file. We will update the UI to provide more detailed error messages. In the meantime, if you are familiar with rclone, you can use it directly to copy files to your bucket.

rclone config create remote "google cloud storage" service_account_credentials "<service_account_credentials>" location "<location>" bucket_policy_only "true"

rclone config create remote "google cloud storage" service_account_credentials "<service_account_credentials>" location "<location>" bucket_policy_only "true"

rclone copy <source> <destination>

rclone copy <source> <destination>

CaiOP•12/21/24, 10:21 PM

It turned out to be a very stupid issue with my pod ran out of RAM and container was OOM killed, but in UI status was "running", so I've realized what's happening only when looked into logs. Because of "running" state that's was able to click on "cloud sync" button, submit form, etc., but not to actually do sync.

"Something went wrong!" when trying to sync with Google Cloud Storage

Similar Threads

Similar Threads

Similar Threads