Could I use R2 bucket as a backup for my personal storage? I have around 50Gb data and I need to bac

Could I use R2 bucket as a backup for my personal storage? I have around 50Gb data and I need to back it up, just for personal use. Does this violence any terms of R2? Anyone help me to clear this please, thank you so much. More information: I was using S3 for the same purpose.

kian•10/17/23, 4:07 PM

That's fine.

HHữu Phong Could I use R2 bucket as a backup for my personal storage? I have around 50Gb da...

Erisa•10/17/23, 4:58 PM

That's completely fine and has no issues

Ercan•10/17/23, 5:38 PM

Hi, we have been using Cloudflare Images for our images storage for 1 year. But as our traffic increase the pricing has increased too much considering the amount of storaged image and delivered images over 1m+. So, we have been looking for a way to move all images to r2 storage and use it from there, and we think the pricing will go down. How can we migrate from Cloudflare images to the R2 ?

bghira•10/17/23, 5:38 PM

@xPaghkman using a Worker, i think

bghira•10/17/23, 5:39 PM

you can serve assets through that, from R2

bghira•10/17/23, 5:39 PM

for migration specifically, not sure

bghira•10/17/23, 5:40 PM

for my needs, i am wondering if anyone has a drop-in solution or idea for boto3, how to use a something like, Redis instance for handling file list operations

bghira•10/17/23, 5:41 PM

i can make one for myself, that i would just wrap the write/delete/list operations to use redis for reads and update it when i do writes. but maybe i missed something obvious

bghira•10/17/23, 5:42 PM

i was already thinking of having Redis support in my application for other needs like, more efficiently orchestrating cluster operations than how we do it now, which would reduce our billing needs

Ercan•10/17/23, 5:47 PM

I am able to serve images from r2 easily, but the things is first I need to move all images to R2 somehow. And after that I am gonna add rules to rewrite the old images url to the new image resizing worker for backward compatibility. But need to figure out migration part.

bghira•10/17/23, 5:51 PM

i don't know if there's a built-in means. i would just use a python script to programmatically pull the Images and push to R2

bghira•10/17/23, 5:52 PM

probably a very naive approach

Bbghira i don't know if there's a built-in means. i would just use a python script to pr...

Ercan•10/17/23, 6:14 PM

Looks like that is gonna be the way. But I read somewhere that Cloudflare Images is also using their R2 under the hood, so I am trying to confirm like if there is any other way than doing this manually.

EErcan Hi, we have been using Cloudflare Images for our images storage for 1 year. But ...

Chaika•10/17/23, 6:17 PM

if it's helpful, they're going to be changing the pricing of Images on November 15th and combining Images and Image Resizing: https://blog.cloudflare.com/merging-images-and-image-resizing/
I don't think that affects raw Images pricing though, If you are big enough, you could consider going Enterprise and talking to Sales

The Cloudflare Blog

Image optimization made simpler and more predictable: we’re merging...

We’re changing how we bill for Image Resizing to let you calculate your monthly costs more accurately and reliably. All Image Resizing features will be available under Cloudflare Images

CChaika if it's helpful, they're going to be changing the pricing of Images on November ...

Ercan•10/17/23, 7:00 PM

Hmm looks like new pricing will be more expensive if I use image resizing + r2. Did not know about this blog.

Ercan•10/17/23, 7:03 PM

It is interesting that cloudflare has decided going with unit numbers for image count or resize count on this product. We will probably look for alternatives that relies storage size.

EErcan Hmm looks like new pricing will be more expensive if I use image resizing + r2. ...

Erisa•10/17/23, 7:04 PM

Are you sure? The new pricing also makes major changes to how resizes are counted, its only unique transforms so if you resize the same image in the same way multiple times youre only billed once per month, rather than each time like currently.

Erisa•10/17/23, 7:05 PM

The new pricing should be cheaper for almost every use-case

EErisa Are you sure? The new pricing also makes major changes to how resizes are counte...

Ercan•10/17/23, 7:08 PM

I am just trying to imagine our use-case which is in a mobile app generally we show different small-medium-original size of images because of the performance, this is generally how it is in mobile apps. And we currently have over 3M+ image delivery per month including all variants of the image sizes.

Erisa•10/17/23, 7:09 PM

I see

Ercan•10/17/23, 7:10 PM

Actually it would be much clear for us to calculate things if we were able to see currently on Cloudflare images the stats of what is the percentage of same image variant (size) out of total delivered image

stickfigure•10/17/23, 9:41 PM

Do presigned urls work with the custom domains? I can't find any examples out there, and haven't been able to get it to work myself (401s).

Sstickfigure Do presigned urls work with the custom domains? I can't find any examples out th...

Hello, I’m Allie!•10/17/23, 9:59 PM

They do not, no

stickfigure•10/17/23, 10:12 PM

That would explain it - thanks. Definitely feels like something that should be in the docs.

Sstickfigure That would explain it - thanks. Definitely feels like something that should be i...

Erisa•10/18/23, 10:03 AM

Agreed - https://github.com/cloudflare/cloudflare-docs/pull/11339

GitHub

[R2] Clarify presigned URLs don't work on custom domains by Erisa ·...

This keeps coming up in the Developer Community

Kirmola•10/18/23, 12:16 PM

I have a question, what is the max. limit for resources that can be cached which are stored in R2, is it object level or entire bucket level

KKirmola I have a question, what is the max. limit for resources that can be cached which...

Hello, I’m Allie!•10/18/23, 1:22 PM

There isn't any limit, objects will just get ejected from cache at some point

Hello, I’m Allie!•10/18/23, 1:22 PM

As in, you are never guaranteed cache space(by number of objects anyway)

Hello, I’m Allie!•10/18/23, 1:23 PM

Size of objects can determine whether it can be cached at all, but that is something else

yinxingmaiming6409•10/18/23, 2:48 PM

S3 pre signed URL, how to cross domains?

bghira•10/18/23, 3:01 PM

is it more efficient to HEAD a file that may not exist or fail to GET it?

bghira•10/18/23, 3:02 PM

eg. would adding a HEAD to the beginning of reads cause a problem?

Awkrill•10/18/23, 3:15 PM

Awkrill•10/18/23, 3:15 PM

How do I get Class a Operations? in R2

Awkrill•10/18/23, 3:15 PM

Can anyone help me ?

AAwkrill Click to see attachment

Unsmart•10/18/23, 3:15 PM

UUnsmart Click to see attachment

Awkrill•10/18/23, 3:16 PM

How to ?

Unsmart•10/18/23, 3:16 PM

It's at the bottom of the screenshot these are the class A operations:
ListBuckets, PutBucket, ListObjects, PutObject, CopyObject, CompleteMultipartUpload, CreateMultipartUpload, ListMultipartUploads, UploadPart, UploadPartCopy and PutBucketEncryption.

Awkrill•10/18/23, 3:22 PM

Does that mean you automatically enter class A?

Bbghira is it more efficient to HEAD a file that may not exist or fail to GET it?

digitalpoint•10/18/23, 3:22 PM

A HEAD request counts the same as a GET request as far as both being a class B operation. So checking if an object exists before actually getting it will be 2 class B operations (and probably make things slower overall because you are making 2 API calls that aren't run in parallel).

UUnsmart It's at the bottom of the screenshot these are the class A operations: ListBucke...

Awkrill•10/18/23, 3:22 PM

Can't buy class A straight away?

Ddigitalpoint A HEAD request counts the same as a GET request as far as both being a class B o...

bghira•10/18/23, 3:22 PM

was thinking that too

bghira•10/18/23, 3:23 PM

i do head before a put though

AAwkrill Can't buy class A straight away?

digitalpoint•10/18/23, 3:23 PM

"Class A" operations aren't a higher/faster tier you are trying to get into. Class A (generally) are write operations, class B are (generally) read operations.

Awkrill•10/18/23, 3:24 PM

ahhh i see

Awkrill•10/18/23, 3:24 PM

thanks

Bbghira i do head before a put though

digitalpoint•10/18/23, 3:24 PM

Ya, depends on your application. If you need to make sure you aren't overwriting something inadvertently, it would make sense to do a HEAD before a PUT.

kian•10/18/23, 3:25 PM

depending on what you're looking for in the

HEAD

HEAD

(i.e if it exists at all, or for modified date/etag) then you could use conditional uploads

Ddigitalpoint Ya, depends on your application. If you need to make sure you aren't overwriting...

bghira•10/18/23, 3:27 PM

it's deterministic and overwriting isn't the end of the world but avoiding class A is the goal there

bghira•10/18/23, 3:28 PM

i actually keep a cached list of bucket contents and remove entries when they are deleted, so that i can avoid having to do a head or list_objects etc, for the most part. but i still have it there for the more expensive write operations, as they are operating in parallel

Could I use R2 bucket as a backup for my personal storage? I have around 50Gb data and I need to bac

Similar Threads

Similar Threads

Similar Threads