R2 query through API returns every objects from bucket exactly 24 times. What can be the problem? Se

R2 query through API returns every objects from bucket exactly 24 times. What can be the problem? See details in attached text file.

r2_query.txt1.05KB

Nnagyt234 R2 query through API returns every objects from bucket exactly 24 times. What ca...

Karew•8/7/23, 9:25 AM

I don’t think the log endpoint is meant to enumerate all of your bucket objects that way. You should use the S3 API if you want to list or manage the bucket objects

KKarew I don’t think the log endpoint is meant to enumerate all of your bucket objects ...

nagyt234OP•8/7/23, 9:33 AM

Sorry, but it is definitely described here: https://developers.cloudflare.com/logs/r2-log-retrieval/#query-logs

Logs Engine · Cloudflare Logs docs

Logs Engine gives you the ability to store your logs in R2 and query them directly.

kian•8/7/23, 9:34 AM

You might want to post your question in #logs-engine

Phil11•8/7/23, 10:35 AM

Hello, anyone know how to remove domain from R2? I need to use it on other bucket...but can't remove from existing.

The domain was added by R2. When I try remove from DNS even, it just sends me back here....

nolimits4web•8/7/23, 12:18 PM

Hello everyone

I think I’m doing something wrong but whatever i tried i can’t purge cache for the single file in r2 storage.

I’ve added custom domain for my r2 storage at cdn.sub.main.comcdn.sub.main.com.
Uploaded the file which is available at cdn.sub.main.com/file.jscdn.sub.main.com/file.js. Rewriting the same file with S3 API or manually in dashboard doesn’t clean its cache and still serves the old version.
tried to use purge cache API to purge cache for specified file passing https://cdn.sub.main.com/file.jshttps://cdn.sub.main.com/file.js doesn’t work. Same if i pass that file URL through cloudflare dashboard in Caching → Configuration → Custom purge. Cache stays there
It works only if i hit purge everything but its not an option for me.

So maybe there is a some specific URL for that file to purge its cache correctly or is there another option to do that?

Please help

Nnolimits4web Hello everyone 👋 I think I’m doing something wrong but whatever i tried i can’...

Karew•8/7/23, 12:32 PM

How long are you waiting? Cache purges can take like ~30 seconds, or maybe more if you have Tiered Cache turned on

KKarew How long are you waiting? Cache purges can take like ~30 seconds, or maybe more ...

nolimits4web•8/7/23, 12:41 PM

I waited for 1 day, no effect)) Purge Everything works immediately

KKarew How long are you waiting? Cache purges can take like ~30 seconds, or maybe more ...

nolimits4web•8/7/23, 12:41 PM

I waited for 1 day, no effect)) Purge Everything works immediately

nagyt234OP•8/7/23, 4:16 PM

HI everybody! Could somebody send me a simple curl example to list R2 buckets thriough S3 API. I've never used S3 and I have no idea how to to do it.

Fernando Dilland•8/7/23, 10:52 PM

I really like CF R2, do you think there is a problem that I used it as my cloud to save personal files? For the few GB that it stored, it is cheaper than Google Drive

Karew•8/7/23, 11:01 PM

It’s IMO not the most ideal way to back up personal files, but if it’s currently cheaper for you, go for it

leostera•8/8/23, 1:03 AM

hi folks, is there a quick way to empty a bucket?

Lleostera hi folks, is there a quick way to empty a bucket?

Karew•8/8/23, 1:06 AM

Rclone's purgepurge command

leostera•8/8/23, 1:13 AM

oops – i removed the bucket with purgepurge

leostera•8/8/23, 3:19 AM

is there a recommended way of using r2 to setup a cdn? I'm coming from s3+cloudfront

Lleostera is there a recommended way of using r2 to setup a cdn? I'm coming from s3+cloudf...

Karew•8/8/23, 3:21 AM

If you add a custom domain to an R2 bucket in your settings, you have the full Cloudflare CDN and all of the cache rules, security tools, etc available to your bucket

leostera•8/8/23, 3:21 AM

cool, okay, so it should be set up then!

leostera•8/8/23, 3:21 AM

the reason i was dubious i did the write thing is that i'm seeing a LOT of lag/delay from writing to being able to read

CcallMeSomething Is there a way to set a rule or something to ensure no files over a certain size...

Karew•8/8/23, 3:22 AM

I think you’d have to enforce that at upload time. I’m not aware of any kind of automated rule like that

Dahoom•8/8/23, 6:58 AM

I was testing a script yesterday and had some issues where it was repeating requests and I have this caused because of it.

Dahoom•8/8/23, 6:58 AM

Its been over 12 hours since these fils have failed the multiplart upload yet they are still showing up there

Dahoom•8/8/23, 7:00 AM

Am i going to have any side affects changing the default value? Its probably at 7 for a reason

Dahoom•8/8/23, 7:01 AM

alright thank you

Karbust•8/8/23, 9:38 AM

Can anyone explain to me why the difference? (First image from TeamCity, second image from Cloudflare R2 dashboard, third image the downloaded file directly from R2 dashboard)

Anu•8/8/23, 9:54 AM

I was looking at R2 data storage locations and learned that we can set a hint, eg, West European region. However, I could not find where exactly it would store the data, i.e., in which country within the West Europe region. Does anyone know where I can get more granular information about storage locations?

Erisa•8/8/23, 10:15 AM

There currently isn't any information about the exact locations, it could be anywhere within West Europe

Unsmart•8/8/23, 8:18 PM

If you use the workers binding yes. If you are using the s3 api over http its 50 / 1000 respectively

Iice_cap are files on r2 automatically cached?

Erisa•8/8/23, 8:42 PM

The Workers binding and S3-compatible API don't cache anything.
Custom Domains abide by the Default Cache Behaviour and can be customised with Cache Rules to cache more or less

Default Cache Behavior · Cloudflare Cache (CDN) docs

Cloudflare respects the origin web server’s cache headers in the following order unless an Edge Cache TTL page rule overrides the headers.

Erisa•8/8/23, 8:45 PM

Yes, R2 custom domains go through the CDN

Erisa•8/8/23, 8:48 PM

What do you mean by acceptable values? Where are you adding those?

Erisa•8/8/23, 8:52 PM

If the file is under "Default cached file extensions" then it will be cached on a custom domain without you needing to add anything

Erisa•8/8/23, 8:52 PM

If not, you can skip anything about headers (since R2 is not an origin server) and use either Page Rules or Cache Rules
https://developers.cloudflare.com/cache/how-to/edge-browser-cache-ttl/create-page-rules/
https://developers.cloudflare.com/cache/how-to/cache-rules/
to configure what is cached and for how long

R2 query through API returns every objects from bucket exactly 24 times. What can be the problem? Se

Similar Threads

Similar Threads

Similar Threads