Hi, so does anyone know of a good tool to make a publicly facing list of all the contents in an r2 b

Hi, so does anyone know of a good tool to make a publicly facing list of all the contents in an r2 bucket? Kind of something like the Apache DirectoryIndex feature... (that is also compatible with workers, or pages)

kian•10/16/23, 10:49 PM

https://github.com/kotx/render

GitHub

GitHub - kotx/render: Cloudflare Worker to proxy and cache requests...

Cloudflare Worker to proxy and cache requests to R2 - GitHub - kotx/render: Cloudflare Worker to proxy and cache requests to R2

mavxyzOP•10/16/23, 10:49 PM

merci

Erisa•10/16/23, 11:31 PM

Not currently possible to log events like that

EErisa Not currently possible to log events like that

polymo1•10/16/23, 11:57 PM

Will it be possible in the future?

EErisa Not currently possible to log events like that

Raiyan•10/17/23, 12:17 AM

is there any plan for r2 upload triggers with worker?

Raiyan•10/17/23, 12:18 AM

?r2-roadmap

Flare•10/17/23, 12:18 AM

These features are now available!!

Object Lifecycles: https://developers.cloudflare.com/r2/buckets/object-lifecycles/
Public buckets, with custom domains: https://developers.cloudflare.com/r2/data-access/public-buckets/#enable-public-access-for-your-bucket
Presigned URLs in the S3-compatible API
Location Hints (e.g. 'EU')
Object Migration (S3->R2)

mavxyzOP•10/17/23, 1:06 AM

~~NoSuchKey: The specified key does not exist.NoSuchKey: The specified key does not exist. does this mean that I provided the wrong access key?~~

mavxyzOP•10/17/23, 1:08 AM

~~I've never felt more puzzled~~

Mmavxyz ~~`NoSuchKey: The specified key does not exist.` does this mean that I provided ...

Unsmart•10/17/23, 1:15 AM

It means the object doesnt exist for the specific key you gave for a get

UUnsmart It means the object doesnt exist for the specific key you gave for a get

mavxyzOP•10/17/23, 1:25 AM

Solved! It turns out I flip flopped the access and secret keys; that was quite embarrasing. Thank you for your assistance!

Matt•10/17/23, 6:45 AM

@Unsmart | Tech debt nice to see you here

Mmavxyz Hi, so does anyone know of a good tool to make a publicly facing list of all the...

RyanKnack•10/17/23, 7:36 AM

Bump I also kinda need this lol

Kkian https://github.com/kotx/render

Sam•10/17/23, 7:44 AM

@RyanKnack

RyanKnack•10/17/23, 7:45 AM

Sorry my reading abilities are an absolute horrendous crap

saviourdog•10/17/23, 9:44 AM

Hi,I configured a custom domain in the r2 bucket, but I do not want to use the custom domain for public access, because I want to use the signature url to access, what should I do

Ssaviourdog Hi,I configured a custom domain in the r2 bucket, but I do not want to use the ...

Hello, I’m Allie!•10/17/23, 10:57 AM

The custom domain is only for public access, so if you don’t want that, remove it

unravler•10/17/23, 11:55 AM

Hey folks, i was setting up my django app to use CloudFlare R2 ( using django-storages, boto3 ) but right now am getting EndointConnectionError. Idk what i did wrong, gave the proper config to django, access key secrets keys bucket name s3 url and region name to auto, and everything. Can anyone help? I am nearing a deadline to submit this project, so help would be appreciated!! Oh btw i also did my CORS policy. However i didnt any public access domains. What to do now…?

MMatt @Unsmart | Tech debt nice to see you here 🙂

Unsmart•10/17/23, 12:01 PM

Hey Matt! Nice to see you too

Jose Jonatas•10/17/23, 2:18 PM

Hello, I'm using a data storage service to store updates for a game made in Unity. Updates are 265mb in size, with the bucket being able to reach 1gb. However, according to the print, the value for bandwidth is very high, making it unfeasible to use this service. The values shown in the print refer to only 3 days of using the service. I would like to know if the R2 can be an alternative to this or not and what the price would be taking into account the consumption recorded in 3 days.

Jose Jonatas•10/17/23, 2:19 PM

Bandwith consumption was 845 Tb in 3 days!

JJose Jonatas Hello, I'm using a data storage service to store updates for a game made in Unit...

digitalpoint•10/17/23, 2:25 PM

Pricing is based on peak storage and requests. Say you had 100GB stored and 100M requests were made to fetch data stored in a month, the total cost would be $33.94/month (egress/bandwidth is not billable).

https://developers.cloudflare.com/r2/pricing/#r2-pricing

Pricing · Cloudflare R2 docs

R2 charges based on the total volume of data stored, along with two classes of operations on that data:

Ddigitalpoint Pricing is based on peak storage and requests. Say you had 100GB stored and 100M...

Jose Jonatas•10/17/23, 2:27 PM

Great news, I'm going to use the R2 service and see what the result will be, thank you

Hữu Phong•10/17/23, 4:03 PM

Could I use R2 bucket as a backup for my personal storage? I have around 50Gb data and I need to back it up, just for personal use. Does this violence any terms of R2? Anyone help me to clear this please, thank you so much. More information: I was using S3 for the same purpose.

kian•10/17/23, 4:07 PM

That's fine.

HHữu Phong Could I use R2 bucket as a backup for my personal storage? I have around 50Gb da...

Erisa•10/17/23, 4:58 PM

That's completely fine and has no issues

Ercan•10/17/23, 5:38 PM

Hi, we have been using Cloudflare Images for our images storage for 1 year. But as our traffic increase the pricing has increased too much considering the amount of storaged image and delivered images over 1m+. So, we have been looking for a way to move all images to r2 storage and use it from there, and we think the pricing will go down. How can we migrate from Cloudflare images to the R2 ?

bghira•10/17/23, 5:38 PM

@xPaghkman using a Worker, i think

bghira•10/17/23, 5:39 PM

you can serve assets through that, from R2

bghira•10/17/23, 5:39 PM

for migration specifically, not sure

bghira•10/17/23, 5:40 PM

for my needs, i am wondering if anyone has a drop-in solution or idea for boto3, how to use a something like, Redis instance for handling file list operations

bghira•10/17/23, 5:41 PM

i can make one for myself, that i would just wrap the write/delete/list operations to use redis for reads and update it when i do writes. but maybe i missed something obvious

bghira•10/17/23, 5:42 PM

i was already thinking of having Redis support in my application for other needs like, more efficiently orchestrating cluster operations than how we do it now, which would reduce our billing needs

Ercan•10/17/23, 5:47 PM

I am able to serve images from r2 easily, but the things is first I need to move all images to R2 somehow. And after that I am gonna add rules to rewrite the old images url to the new image resizing worker for backward compatibility. But need to figure out migration part.

bghira•10/17/23, 5:51 PM

i don't know if there's a built-in means. i would just use a python script to programmatically pull the Images and push to R2

bghira•10/17/23, 5:52 PM

probably a very naive approach

Bbghira i don't know if there's a built-in means. i would just use a python script to pr...

Ercan•10/17/23, 6:14 PM

Looks like that is gonna be the way. But I read somewhere that Cloudflare Images is also using their R2 under the hood, so I am trying to confirm like if there is any other way than doing this manually.

EErcan Hi, we have been using Cloudflare Images for our images storage for 1 year. But ...

Chaika•10/17/23, 6:17 PM

if it's helpful, they're going to be changing the pricing of Images on November 15th and combining Images and Image Resizing: https://blog.cloudflare.com/merging-images-and-image-resizing/
I don't think that affects raw Images pricing though, If you are big enough, you could consider going Enterprise and talking to Sales

The Cloudflare Blog

Image optimization made simpler and more predictable: we’re merging...

We’re changing how we bill for Image Resizing to let you calculate your monthly costs more accurately and reliably. All Image Resizing features will be available under Cloudflare Images

CChaika if it's helpful, they're going to be changing the pricing of Images on November ...

Ercan•10/17/23, 7:00 PM

Hmm looks like new pricing will be more expensive if I use image resizing + r2. Did not know about this blog.

Ercan•10/17/23, 7:03 PM

It is interesting that cloudflare has decided going with unit numbers for image count or resize count on this product. We will probably look for alternatives that relies storage size.

EErcan Hmm looks like new pricing will be more expensive if I use image resizing + r2. ...

Erisa•10/17/23, 7:04 PM

Are you sure? The new pricing also makes major changes to how resizes are counted, its only unique transforms so if you resize the same image in the same way multiple times youre only billed once per month, rather than each time like currently.

Erisa•10/17/23, 7:05 PM

The new pricing should be cheaper for almost every use-case

EErisa Are you sure? The new pricing also makes major changes to how resizes are counte...

Ercan•10/17/23, 7:08 PM

I am just trying to imagine our use-case which is in a mobile app generally we show different small-medium-original size of images because of the performance, this is generally how it is in mobile apps. And we currently have over 3M+ image delivery per month including all variants of the image sizes.

Erisa•10/17/23, 7:09 PM

I see

Ercan•10/17/23, 7:10 PM

Actually it would be much clear for us to calculate things if we were able to see currently on Cloudflare images the stats of what is the percentage of same image variant (size) out of total delivered image

stickfigure•10/17/23, 9:41 PM

Do presigned urls work with the custom domains? I can't find any examples out there, and haven't been able to get it to work myself (401s).

Sstickfigure Do presigned urls work with the custom domains? I can't find any examples out th...

Hello, I’m Allie!•10/17/23, 9:59 PM

They do not, no

stickfigure•10/17/23, 10:12 PM

That would explain it - thanks. Definitely feels like something that should be in the docs.

Sstickfigure That would explain it - thanks. Definitely feels like something that should be i...

Erisa•10/18/23, 10:03 AM

Agreed - https://github.com/cloudflare/cloudflare-docs/pull/11339

GitHub

[R2] Clarify presigned URLs don't work on custom domains by Erisa ·...

This keeps coming up in the Developer Community

Kirmola•10/18/23, 12:16 PM

I have a question, what is the max. limit for resources that can be cached which are stored in R2, is it object level or entire bucket level

Hi, so does anyone know of a good tool to make a publicly facing list of all the contents in an r2 b

Similar Threads