Just wondering if there's a way to move a bucket to another region while keeping its name and conten

SSpike Just wondering if there's a way to move a bucket to another region while keeping...

C

Chaika•12/3/24, 1:31 AM

Sadly not. Best you can do is make a second bucket and then rclone the contents over.
It may be worth pointing out as well

Location Hints are only honored the first time a bucket with a given name is created. If you delete and recreate a bucket with the same name, the original bucket’s location will be used.

CChaika Sadly not. Best you can do is make a second bucket and then rclone the contents ...

S

SpikeOP•12/3/24, 1:33 AM

Ah, that's what's happened. I definitely hinted at APAC but I think that region wasn't available when I first created the bucket a while back.

CChaika Sadly not. Best you can do is make a second bucket and then rclone the contents ...

S

SpikeOP•12/3/24, 1:33 AM

I assume I could also use the super slurper to do the migration?

SSpike I assume I could also use the super slurper to do the migration?

C

Chaika•12/3/24, 1:36 AM

As long as you fit within the limits yea, can't do objects over 1 tb

CChaika As long as you fit within the limits yea, can't do objects over 1 tb

S

SpikeOP•12/3/24, 1:37 AM

All good

It was just a recent migration from S3 so definitely fits that condition.

SSpike Ah, that's what's happened. I definitely hinted at APAC but I think that region ...

C

Chaika•12/3/24, 1:37 AM

hmm I'm pretty sure APAC has always been available & they've only added hints with actual support in the region, possible it didn't listen or something else happened though, whatever it says for bucket location under settings is what matters though

CChaika hmm I'm pretty sure APAC has always been available & they've only added hints wi...

S

SpikeOP•12/3/24, 1:38 AM

Interesting. I'll definitely make sure it's the case before I begin the migration

B

BluB•12/3/24, 3:51 AM

full cors

Full Cors

[
  {
    "AllowedOrigins": [
      "*"
    ],
    "AllowedMethods": [
      "HEAD",
      "GET",
      "POST",
      "PUT",
      "DELETE"
    ],
    "AllowedHeaders": [
      "*"
    ],
    "ExposeHeaders": [
      "*"
    ],
    "MaxAgeSeconds": 3600
  }
]

[
  {
    "AllowedOrigins": [
      "*"
    ],
    "AllowedMethods": [
      "HEAD",
      "GET",
      "POST",
      "PUT",
      "DELETE"
    ],
    "AllowedHeaders": [
      "*"
    ],
    "ExposeHeaders": [
      "*"
    ],
    "MaxAgeSeconds": 3600
  }
]

[
  {
    "AllowedOrigins": [
      "*"
    ],
    "AllowedMethods": [
      "HEAD",
      "GET",
      "POST",
      "PUT",
      "DELETE"
    ],
    "AllowedHeaders": [
      "*"
    ],
    "ExposeHeaders": [
      "*"
    ],
    "MaxAgeSeconds": 3600
  }
]

[
  {
    "AllowedOrigins": [
      "*"
    ],
    "AllowedMethods": [
      "HEAD",
      "GET",
      "POST",
      "PUT",
      "DELETE"
    ],
    "AllowedHeaders": [
      "*"
    ],
    "ExposeHeaders": [
      "*"
    ],
    "MaxAgeSeconds": 3600
  }
]

B

BluB•12/3/24, 3:51 AM

so I have this code

import { S3Client, ListObjectsV2Command, ListBucketsCommand } from "@aws-sdk/client-s3";

async function checkAuthentication() {
        client.current = new S3Client({
            region: "auto",
            credentials: {
                accessKeyId: accessKeyId,
                secretAccessKey: secretAccessKey,
            },
            endpoint: `https://${accountId}.r2.cloudflarestorage.com`,
            forcePathStyle: true,
        });
        setAuthMessage("Case 1")


        try {
            // @ts-ignore
            await refreshBuckets(null, true)
            setIsAuthenticated(true)
            setAuthMessage("Verified")
        } catch (err) {
            // @ts-ignore
            console.error("S3 Client authentication failed:", err.message);
            setIsAuthenticated(false)
            setAuthMessage(`err ${err}`)
        }
        // setAuthMessage("??")
    }

 async function refreshBuckets(_e: MouseEventHandler<HTMLButtonElement>, throwErr = false) {
        try {
            // @ts-ignore
            /*
             {
    "AllowedOrigins": ["*"],
    "AllowedMethods": ["GET", "POST", "PUT", "DELETE"],
    "AllowedHeaders": ["*"],
    "MaxAgeSeconds": 3000
  }
             */
            client.current.send(new ListBucketsCommand({})).then((r) => {
                setA(r.$metadata)
            }).catch((err) => {
                setA(err.toString())
            })
            const data = await client.current.send(new ListBucketsCommand({}))
            // console.log(data);
        } catch (err) {
            // data = []
            if (throwErr) {
                throw err;
            }
        }
    }

import { S3Client, ListObjectsV2Command, ListBucketsCommand } from "@aws-sdk/client-s3";

async function checkAuthentication() {
        client.current = new S3Client({
            region: "auto",
            credentials: {
                accessKeyId: accessKeyId,
                secretAccessKey: secretAccessKey,
            },
            endpoint: `https://${accountId}.r2.cloudflarestorage.com`,
            forcePathStyle: true,
        });
        setAuthMessage("Case 1")


        try {
            // @ts-ignore
            await refreshBuckets(null, true)
            setIsAuthenticated(true)
            setAuthMessage("Verified")
        } catch (err) {
            // @ts-ignore
            console.error("S3 Client authentication failed:", err.message);
            setIsAuthenticated(false)
            setAuthMessage(`err ${err}`)
        }
        // setAuthMessage("??")
    }

 async function refreshBuckets(_e: MouseEventHandler<HTMLButtonElement>, throwErr = false) {
        try {
            // @ts-ignore
            /*
             {
    "AllowedOrigins": ["*"],
    "AllowedMethods": ["GET", "POST", "PUT", "DELETE"],
    "AllowedHeaders": ["*"],
    "MaxAgeSeconds": 3000
  }
             */
            client.current.send(new ListBucketsCommand({})).then((r) => {
                setA(r.$metadata)
            }).catch((err) => {
                setA(err.toString())
            })
            const data = await client.current.send(new ListBucketsCommand({}))
            // console.log(data);
        } catch (err) {
            // data = []
            if (throwErr) {
                throw err;
            }
        }
    }

import { S3Client, ListObjectsV2Command, ListBucketsCommand } from "@aws-sdk/client-s3";

async function checkAuthentication() {
        client.current = new S3Client({
            region: "auto",
            credentials: {
                accessKeyId: accessKeyId,
                secretAccessKey: secretAccessKey,
            },
            endpoint: `https://${accountId}.r2.cloudflarestorage.com`,
            forcePathStyle: true,
        });
        setAuthMessage("Case 1")


        try {
            // @ts-ignore
            await refreshBuckets(null, true)
            setIsAuthenticated(true)
            setAuthMessage("Verified")
        } catch (err) {
            // @ts-ignore
            console.error("S3 Client authentication failed:", err.message);
            setIsAuthenticated(false)
            setAuthMessage(`err ${err}`)
        }
        // setAuthMessage("??")
    }

 async function refreshBuckets(_e: MouseEventHandler<HTMLButtonElement>, throwErr = false) {
        try {
            // @ts-ignore
            /*
             {
    "AllowedOrigins": ["*"],
    "AllowedMethods": ["GET", "POST", "PUT", "DELETE"],
    "AllowedHeaders": ["*"],
    "MaxAgeSeconds": 3000
  }
             */
            client.current.send(new ListBucketsCommand({})).then((r) => {
                setA(r.$metadata)
            }).catch((err) => {
                setA(err.toString())
            })
            const data = await client.current.send(new ListBucketsCommand({}))
            // console.log(data);
        } catch (err) {
            // data = []
            if (throwErr) {
                throw err;
            }
        }
    }

import { S3Client, ListObjectsV2Command, ListBucketsCommand } from "@aws-sdk/client-s3";

async function checkAuthentication() {
        client.current = new S3Client({
            region: "auto",
            credentials: {
                accessKeyId: accessKeyId,
                secretAccessKey: secretAccessKey,
            },
            endpoint: `https://${accountId}.r2.cloudflarestorage.com`,
            forcePathStyle: true,
        });
        setAuthMessage("Case 1")


        try {
            // @ts-ignore
            await refreshBuckets(null, true)
            setIsAuthenticated(true)
            setAuthMessage("Verified")
        } catch (err) {
            // @ts-ignore
            console.error("S3 Client authentication failed:", err.message);
            setIsAuthenticated(false)
            setAuthMessage(`err ${err}`)
        }
        // setAuthMessage("??")
    }

 async function refreshBuckets(_e: MouseEventHandler<HTMLButtonElement>, throwErr = false) {
        try {
            // @ts-ignore
            /*
             {
    "AllowedOrigins": ["*"],
    "AllowedMethods": ["GET", "POST", "PUT", "DELETE"],
    "AllowedHeaders": ["*"],
    "MaxAgeSeconds": 3000
  }
             */
            client.current.send(new ListBucketsCommand({})).then((r) => {
                setA(r.$metadata)
            }).catch((err) => {
                setA(err.toString())
            })
            const data = await client.current.send(new ListBucketsCommand({}))
            // console.log(data);
        } catch (err) {
            // data = []
            if (throwErr) {
                throw err;
            }
        }
    }

I get

TypeError: Load failed

TypeError: Load failed

every time, can anyone tell me why?

S

Sam•12/3/24, 2:27 PM

Same @Bnael

S

Sam•12/3/24, 2:27 PM

It's reaaally slow.

J

JulienDoku•12/3/24, 2:30 PM

Soooo slow!!

I'm based in Paris, France

J

JulienDoku•12/3/24, 2:31 PM

Should be related to this: https://www.cloudflarestatus.com/incidents/dxtbbpscpqm6

Network Performance Issues in Frankfurt, Germany

E

embraxx•12/3/24, 2:46 PM

Several errors from Singapore too, I don't think it's related to the Frankfurt node.

R2 giving either 524 or even 500 errors randomly

C

Chaika•12/3/24, 2:50 PM

Isaac is escalating the issue

C

Chaika•12/3/24, 2:50 PM

yea should be part of status page

Eembraxx Several errors from Singapore too, I don't think it's related to the Frankfurt n...

C

Chaika•12/3/24, 2:50 PM

is your bucket weur/eeur though? (you can see it in the dashboard under your bucket -> settings -> location)

C

Chaika•12/3/24, 2:52 PM

sorry that was to embraxx who said they were getting errors in SIN, was curious about his bucket location

I

Isaac McFadyen•12/3/24, 2:52 PM

Yeah we escalated, thanks for reports.

K

Kasper•12/3/24, 3:03 PM

Yeah thought it was weird that the status page said nothing. But at least I found this useful discord server. We have issues in EEUR.

F

Fua•12/3/24, 3:04 PM

My Bucket location is Eastern Europe (EEUR), And I am able to access some object but some objects are not even loading when i go to cloudflare and search for the image. it is there but i am not able to access it through the subdomain that i set.

F

Fua•12/3/24, 3:04 PM

getting this error

we were not able to find this object cloudflare was unable to retrieve the object at this time. please refresh or try again later.

FFua My Bucket location is Eastern Europe (EEUR), And I am able to access some object...

K

Kasper•12/3/24, 3:06 PM

The same problem as other people here. They are looking into it.

I

Ivan B•12/3/24, 3:12 PM

Greetings, thanks for using Cloudflare R2. We're currently investigating this issue internally and will handle it accordingly.

BBnael any ETA? 🙏

H

High Flying Dwarf•12/3/24, 3:15 PM

There's no ETA currently. This is under investigation and once we know more we will let you know.

K

Kalu•12/3/24, 3:18 PM

The replication of the worldwide R2 is scheduled for one day? This could avoid this kind of problem, as R2 is really slow.

H

High Flying Dwarf•12/3/24, 3:37 PM

We've confirmed that this relates to the incident declared here: https://www.cloudflarestatus.com/incidents/dxtbbpscpqm6

Network Performance Issues in Frankfurt, Germany

N

Naman•12/3/24, 4:13 PM

Hey folks, is there an official/unofficial fair-use policy for Cloudflare R2?
I ask because the egress traffic slider only goes upto 500% in the R2 pricing calculator - https://r2-calculator.cloudflare.com/

So I'm wondering if 5x storage is an unofficial upper bound for the free egress traffic.

N

Naman•12/3/24, 4:14 PM

My use case involves storing ~1TB of data but having monthly egress of ~100TB, hence the question.
I'm happy to pay more in storage, just don't want to mistakenly exceeed some egress quota

N

Naman•12/3/24, 4:15 PM

Also with Hetzner's new S3 compatible object storage announced today, I'm wondering what makes it competitive against Cloudflare R2 for a high traffic use case like mine

NNaman Hey folks, is there an official/unofficial fair-use policy for Cloudflare R2? I ...

T

tezcan•12/3/24, 4:15 PM

I use +350TB traffic every day, I guess there is no limit.

Ttezcan I use +350TB traffic every day, I guess there is no limit.

N

Naman•12/3/24, 4:16 PM

With how much storage?

NNaman With how much storage?

T

tezcan•12/3/24, 4:19 PM

10TB, but cache hit ratio %99.9. If I don't use cache, this means an average instantaneous network usage of 30-35 Gbit on the r2 server cluster where my files are located. It's incredible that they offer this network usage for $150.

M

madelaney•12/3/24, 4:37 PM

I'm looking to migrate ~600Tb from DigitalOcean to CloudFlare R2. I was hoping to take advantage of R2 Workers and/or Sippy to do migration on request but neither, at first glance, seem to support DigitalOcean. DigitalOcean is an S3 compatible API so this should be possible but I haven't seen any documentation where I could provide a custom host/URI that would allow me to pull data from DigitalOcean over AWS or GCP.

Are there any documents that might help me understand how I may accomplish what I'm looking to do?

Mmadelaney I'm looking to migrate ~600Tb from DigitalOcean to CloudFlare R2. I was hoping t...

T

tezcan•12/3/24, 4:41 PM

rclone. simple "rclone sync digiocean:bucket r2:bucket"

Ttezcan rclone. simple "rclone sync digiocean:bucket r2:bucket"

M

madelaney•12/3/24, 4:53 PM

I was looking at rclone. I just wasn't sure if the amount I wanted to migrate over would be problematic. I'll read up more on it.

J

Jason Barry•12/3/24, 11:41 PM

if a conditional PUT doesn't end up writing an object, does it get billed as a Class B operation instead of Class A?

Just wondering if there's a way to move a bucket to another region while keeping its name and conten

Similar Threads

Similar Threads

Similar Threads