My point is that any cache does not need 99.99999999% durability whether it is hot or cold cache. Th

My point is that any cache does not need 99.99999999% durability whether it is hot or cold cache. This durability is not free in terms of performance and money. R2/S3 is slow and costly and not suitable for cache purposes.

Original message was deleted

starina_coolOP•12/19/24, 2:55 PM

It hurt performance on MISS badly. Becouse of Erasure coding used to store files in R2. And implementation is unbelivable. Cache Reserve gets a file from Origin, Writes it to R2 (performing Erasure coding and spreading pieces of the data to different physical servers), then READS it from R2!!! and then send it to a client.

Original message was deleted

starina_coolOP•12/19/24, 2:56 PM

Not According to the pricing

Sstarina_cool My point is that any cache does not need 99.99999999% durability whether it is h...

Chaika•12/19/24, 2:59 PM

Durability is part of the point. It's a guaranteed caching layer, it will hold your objects for the time you specify, for specific use cases where you absolutely don't want to hit the origin: https://blog.cloudflare.com/introducing-cache-reserve/

From your comments, it sounds like you're more looking for Tiered Caching. Free can use Smart Tiered Caching for free, it picks a cf location near your origin to check cache first before requesting. It's normal cache but smarter (and it has the same cache eviction/not guaranteedness/etc of normal cache)

LLLLLL•12/19/24, 4:05 PM

Hello everyone, is there a quick way to transfer 35GB of data from an R2 bucket (located in the United States) to another R2 bucket located in Asia?

LLLLLLL Hello everyone, is there a quick way to transfer 35GB of data from an R2 bucket ...

Hello, I’m Allie!•12/19/24, 4:09 PM

https://developers.cloudflare.com/r2/data-migration/super-slurper/

Cloudflare Docs

Super Slurper · Cloudflare R2 docs

Super Slurper allows you to quickly and easily copy objects from other cloud providers to an R2 bucket of your choice.

fritex•12/19/24, 5:55 PM

Sharing some feedback, maybe it's related to the FileZilla devs

Furthermore, while using FileZilla Pro, on Windows, when I select "Jurisdiction" North America, it does connect and list all buckets no matter if I've selected location hint is EEUR/WEUR or any other.
However, when I select Europe Union, then it lists only those buckets which are "European Union (EU)" for location (literally selected "Specify jurisdicition" while creating such bucket).
So, those wih EEUR or some other location with "Automatic" are listed under the North America in the FileZilla FTP interface.
With selected jurisdiction "North America" I get even those with location "automatic" but selected suggested location hint EEUR, WEUR, etc.

fritex•12/19/24, 5:58 PM

May I ask if using Automatic with location hint EEUR is actually served from outside EU or?

Should I pick EU jurisdiction at first while creating bucket to make sure the data/files are served from the EU and not EEUR?

Ffritex May I ask if using Automatic with location hint EEUR is actually served from out...

Hard@Work•12/19/24, 5:58 PM

If you need GDPR protection, choose the EU Jurisdiction

Hard@Work•12/19/24, 5:59 PM

Location Hints are Hints, which means that we do not guarantee that they are respected

Hard@Work•12/19/24, 5:59 PM

Jurisdictions will be respected

fritex•12/19/24, 5:59 PM

Does it mean I'd have to delete and create again the bucket or I might be able to modify this EEUR to EU?

fritex•12/19/24, 5:59 PM

I guessed if I pick EEUR, I want to serve files from EEUR location(s), not WEUR since is more farther for my customers.

Ffritex Does it mean I'd have to delete and create again the bucket or I might be able t...

Hard@Work•12/19/24, 6:00 PM

You would have to create a bucket with a new name with that jurisdiction

Hard@Work•12/19/24, 6:00 PM

Bucket Locations are persisted across deletes

HHard@Work You would have to create a bucket with a new name with that jurisdiction

fritex•12/19/24, 6:00 PM

Ouch! After 5mil files moved and 100s gigabytes, might take me a while again

Ffritex Ouch! After 5mil files moved and 100s gigabytes, might take me a while again 😆

Hard@Work•12/19/24, 6:01 PM

Let me check just to be sure, but if you do need to move, there is , or Slurper for the managed version

HHard@Work Let me check just to be sure, but if you do need to move, there is `rclone`, or ...

fritex•12/19/24, 6:02 PM

Appreciate in advance! Thank you for feedback

Original message was deleted

Hard@Work•12/19/24, 6:03 PM

I mean, for a few hundred gigs, unless you have a great connection, it might still take a while

Original message was deleted

fritex•12/19/24, 6:04 PM

Had no clue for this!
Will give it a try for sure
I do have 1Gbps connection from home and server as well
Used rclone 1st time, was quite fast for approx. ~2mil files and ~160GB vs aws-cli which took me a full day for only ~50GB and ~1mil

Original message was deleted

Hard@Work•12/19/24, 6:05 PM

Huh, weird. Might be doing something wrong, but seems to pull via my device for me

Original message was deleted

Hard@Work•12/19/24, 6:05 PM

Yep, same bucket too

Ffritex Appreciate in advance! Thank you for feedback

Hard@Work•12/19/24, 6:06 PM

Just confirmed, if you need GDPR compliance, then you should use the EU jurisdiction

HHard@Work Just confirmed, if you need GDPR compliance, then you should use the EU jurisdic...

fritex•12/19/24, 6:08 PM

Got it, thank you for such fast check and response! I'll write down this information for a reminder for my further buckets.

fritex•12/19/24, 6:10 PM

May I also ask, since I haven't tested much yet, is there any difference for EU jurisdiction bucket, e.g. are files served from EU IP addresses?
https://community.cloudflare.com/t/site-ip-address-changes-very-often/374169/4 -> reminds me onto this and then I wonder if I'd have some issues, with some ISPs blocking or limiting Cloudflare ...

fritex•12/19/24, 6:10 PM

Or it just does mean that the data is being kept inside the EU location(s) for the buckets.

Original message was deleted

fritex•12/19/24, 6:12 PM

May I use this opportunity and ask if there is any difference, or need for this to get it work in the config file for rclone?

Or just define and use R2 API Token which can access read-write for both buckets?

Original message was deleted

fritex•12/19/24, 6:13 PM

Got it, thank you for feedback and help

tokie•12/19/24, 6:13 PM

I asked yesterday but didn't provide an example. I have this R2 custom domain setup automatically by "connecting" it. It's returning a 301 for any URL back to the URL requested. Here's an example: https://sniff.lololo.lol/hello.txt -- I have checked every set of config for the zone and there's no page rules / redirects / etc.

Original message was deleted

Hard@Work•12/19/24, 6:14 PM

Weird

Original message was deleted

tokie•12/19/24, 6:15 PM

there's no redirects enabled for the domain -- except maybe those for https in the ssl config

tokie•12/19/24, 6:16 PM

does r2 only work over http ?

tokie•12/19/24, 6:16 PM

i disabled https rewrites an hour ago

tokie•12/19/24, 6:17 PM

"Automatic HTTPS Rewrites" in the edge certs section that is

Ttokie I asked yesterday but didn't provide an example. I have this R2 custom domain se...

Chaika•12/19/24, 6:19 PM

Your SSL/TLS mode is "Off"

CChaika Your SSL/TLS mode is "Off"

tokie•12/19/24, 6:19 PM

AHAH

tokie•12/19/24, 6:19 PM

thanks!

Chaika•12/19/24, 6:20 PM

should go Full (Strict) or Strict (SSL-Only)

Original message was deleted

Chaika•12/19/24, 6:20 PM

enough to disable the redirect? sure.
something you should use in production? never

tokie•12/19/24, 6:20 PM

yeah, it was disabled and then http->https redirects were enabled

tokie•12/19/24, 6:20 PM

so it got into a little loopies

Chaika•12/19/24, 6:24 PM

I thought R2 Custom Domains were HTTPS only/enforced by the zone under the R2 Custom Domain, evidently not tho

Original message was deleted

Hard@Work•12/19/24, 6:25 PM

This is via the latest via Homebrew, so it should

be up to date

Hard@Work•12/19/24, 6:25 PM

Will check later

Original message was deleted

Hard@Work•12/19/24, 6:26 PM

I have an old key, and no region, but otherwise same

Original message was deleted

Hard@Work•12/19/24, 6:27 PM

Isn't Server-Copy a standard thing for S3?

Original message was deleted

Hard@Work•12/19/24, 6:29 PM

Can do Multipart Copy?

fritex•12/19/24, 6:42 PM

May I ask could we expect somewhere in future to be able to filter buckets on the bucket list, e.g. per location / jurisdiction?

Might be it's able to do it via API, but not on the Dashboard, yet.
Thank you!

fritex•12/19/24, 6:50 PM

If we have e.g. sub-domain on bucket, example:
a) mydomain.hr is main domain
b) then I've got sub-domain sub.mydomain.hr
c) for r2.sub.mydomain.hr -> do I need to pruchase Advanced Certificate Manager to cover that R2 Custom domain which seems to me to be an deep-level sub-domain?

Original message was deleted

Eric Ellis•12/19/24, 6:51 PM

I wonder if this is related to my issue...

EEric Ellis Hello, I've just configured an R2 storage bucket and seeing some failures (inter...

Eric Ellis•12/19/24, 6:52 PM

here