trying to setup event notifications - tutorial is excellent and everything works right up until the

trying to setup event notifications - tutorial is excellent and everything works right up until the last config step where i actually setup the notification - it then gives me workers.api.error.bucket_not_found [code: 10085]. The bucket exists and the name is correct. My bucket, however, is in EU. Could this be the reason it can't find the bucket? ---Just tested with a bucket not in EU and it worked - assume this is a bug

RRAGman trying to setup event notifications - tutorial is excellent and everything works...

Chaika•4/4/24, 5:17 PM

Jurisdictions are still in beta and some parts of the ui don't support them

JJeremy Are there any resources on the inner workings of R2 and what parts are running o...

Chaika•4/4/24, 5:18 PM

I believe it's just the metadata part, would have to see if I could find more info on it

CChaika Jurisdictions are still in beta and some parts of the ui don't support them

RAGmanOP•4/4/24, 5:19 PM

Do you mean jurisdictions globally are still in beta? So, technically, an EU based R2 bucket is in beta? Also, you mention the UI, but I was doing this via Wrangler CLI.

RRAGman Do you mean jurisdictions globally are still in beta? So, technically, an EU ba...

Chaika•4/4/24, 5:21 PM

The jurisdiction feature itself is, being able to create a bucket specifically tied to EU. I know some other parts of the UI/etc don't work with jurisdiction buckets either.
If this was via wrangler, I would make a issue for it on the workers-sdk github to make sure they're aware

CChaika The jurisdiction feature itself is, being able to create a bucket specifically t...

RAGmanOP•4/4/24, 5:22 PM

OK, thank you. I will add the issue to GitHub

JJeremy I see, that would make sense. Thanks

Chaika•4/4/24, 5:23 PM

They're not normal DOs though:
r2
That's all I could find on a quick search. Vitali was one of the lead engineers on R2 (or whatever title he had, I forgot at this point), so if you want more info, I'd look through his posts in this channel

RAGmanOP•4/4/24, 5:27 PM

@Chaika I want to be able to send my event notifications to AWS Lambda for now as I have more experience there. Do you happen to have any links to tutorials on how to do that?

RRAGman @Chaika I want to be able to send my event notifications to AWS Lambda for now ...

Chaika•4/4/24, 5:32 PM

I haven't played around with r2 event notifs yet, but iirc they just use a normal Queue.
https://developers.cloudflare.com/queues/reference/pull-consumers/
You could have a queue customer worker which fetches your lambda and passes the info, or you could even use the HTTP Pull API to have the lambda pull the queue

RRAGman @Chaika I want to be able to send my event notifications to AWS Lambda for now ...

Chaika•4/4/24, 5:34 PM

https://developers.cloudflare.com/r2/examples/upload-logs-event-notifications/#log-and-store-upload-events-in-r2-with-event-notifications
There's a guide here on getting started. You could modify that worker they give as an example writing to R2, to fetch(...) your aws lambda endpoint instead and pass the messages

Cloudflare Docs

Log and store upload events in R2 with event notifications · Cloudf...

This example provides a step-by-step guide on using event notifications to capture and store R2 upload logs in a separate bucket.

arch•4/4/24, 5:34 PM

iirc they just use a normal Queue.

You are correct

I recently implemented them for my own project

CChaika https://developers.cloudflare.com/r2/examples/upload-logs-event-notifications/#l...

RAGmanOP•4/4/24, 5:36 PM

Thanks very much for the tip. That sounds logical. BTW, I previously followed the tutorial you reference and it is excellent. Very clear and easy to follow.

Original message was deleted

Neyunse•4/4/24, 5:40 PM

And what alternative method can I use so that it does not generate so many operations?

NNeyunse And what alternative method can I use so that it does not generate so many opera...

Chaika•4/4/24, 5:44 PM

What do you mean "so many operations"?

Chaika•4/4/24, 5:44 PM

132 Class Bs would cost you = $0.00004752 ((0.36/1,000,000) * 132)
59 Class As would cost you = $0.0002655 ((4.50/1,000,000) * 59)
0.00004752 + 0.0002655 = 0.00031302
1/ 0.00031302 = 3194. It would take you doing that 3194 times to be charged a dollar in use. and that's excluding the 10 mil Class Bs you get, and 1 mill Class As.

CChaika What do you mean "so many operations"?

Neyunse•4/4/24, 5:47 PM

I haven't used my R2 yet, but I have Class A and B Operations

Chaika•4/4/24, 5:47 PM

Right, just looking at your buckets in the dashboard/files/etc will cause Operations to be done

Chaika•4/4/24, 5:48 PM

Class A operations

Class A Operations include ListBuckets, PutBucket, ListObjects, PutObject, CopyObject, CompleteMultipartUpload, CreateMultipartUpload, ListMultipartUploads, UploadPart, UploadPartCopy, ListParts, PutBucketEncryption, PutBucketCors and PutBucketLifecycleConfiguration.

Class B operations

Class B Operations include HeadBucket, HeadObject, GetObject, UsageSummary, GetBucketEncryption, GetBucketLocation, GetBucketCors and GetBucketLifecycleConfiguration.

https://developers.cloudflare.com/r2/pricing/

Chaika•4/4/24, 5:49 PM

The dashboard does a bunch of those. It lists all of the buckets, lists all of the objects/files, you likely created a bucket, if you upload a file via the dashboard. Class Bs would be getting file information, bucket information, bucket location, lifecycle config, etc

Neyunse•4/4/24, 5:52 PM

I understand, now I know where the operations come from. Thank you! I thought they increased if I performed any action outside of RS, for example external requests.

dave•4/4/24, 6:30 PM

for a single part file, will CopyObject keep it as a single part file in the new location?

dave•4/4/24, 6:35 PM

x-amz-copy-source-if-match

x-amz-copy-source-if-match

supposed to be the etag with quotes or without quotes?

dave•4/4/24, 6:39 PM

and it's just

x-amz-copy-source: dest_bucket_on_r2/filename.txt

x-amz-copy-source: dest_bucket_on_r2/filename.txt

right?

dave•4/4/24, 7:28 PM

Is there a way to only allow a Cloudflare Worker to use an R2 token with IP filtering?

Karew•4/4/24, 7:31 PM

I would create a specific token just for your Worker

KKarew I would create a specific token just for your Worker

dave•4/4/24, 7:56 PM

yeah I already did that

Kkian Yes

dave•4/4/24, 8:08 PM

hmm, is there a similar trick to use

If-Unmodified-Since

If-Unmodified-Since

but with CopyObject?

kian•4/4/24, 8:09 PM

cf-copy-destination-if-unmodified-since

cf-copy-destination-if-unmodified-since

dave•4/4/24, 8:09 PM

wait srsly

dave•4/4/24, 8:09 PM

thank you!

kian•4/4/24, 8:09 PM

https://developers.cloudflare.com/r2/api/s3/extensions/#conditional-operations-in-copyobject-for-the-destination-object

kian•4/4/24, 8:10 PM

All the S3 extensions are on that page

dave•4/4/24, 8:10 PM

r2_copy_headers.set("cf-copy-destination-if-unmodified-since", "Thu, 01 Jan 1970 00:00:00 GMT");

r2_copy_headers.set("cf-copy-destination-if-unmodified-since", "Thu, 01 Jan 1970 00:00:00 GMT");

So that'll enforce write-once only?

dave•4/4/24, 8:13 PM

niiiiiiice

Original message was deleted

dave•4/4/24, 8:23 PM

@Erisa | Support Engineer Would it could as two class Bs if a

cf-copy-destination-if-unmodified-since

cf-copy-destination-if-unmodified-since

fails?

Original message was deleted

dave•4/4/24, 9:10 PM

yeah, looks at my metrics now, looks like you're right. I'll leave it running for a bit and see if it changes

hendrik•4/5/24, 11:30 AM

is traffic generated through r2 shown in the domain analytics?

hendrik•4/5/24, 11:30 AM

as well as requests?

hendrik•4/5/24, 11:33 AM

okay thanks

Venkat Dinavahi•4/5/24, 12:48 PM

Hey folks looking for tips/advice on an architecture similar to what imgix does, except adapted to a different use case.

We have an app (cloudflare worker) where you can request files in urls like:
/storage/organizations/clcjbt6kr00021pp49d3e5gtm/folders/clrxn7fgp0000zatqagz06s7c/mydoc.png

Venkat Dinavahi•4/5/24, 12:49 PM

We'd like to perform certain transformations on these files. I liked the cloudflare is doing with images:
https://developers.cloudflare.com/images/transform-images/transform-via-url/

Except it would be different stuff like:

Convert documents to PDF
Get OCR data

Cloudflare Docs

Transform via URL · Cloudflare Image Optimization docs

You can convert and resize images by requesting them via a specially-formatted URL. This way you do not need to write any code, only change HTML …

Venkat Dinavahi•4/5/24, 12:50 PM

The idea is to build something into the url structure that makes processing more seamless for the frontend and caches the results in R2

Venkat Dinavahi•4/5/24, 12:52 PM

in their example they have something like:
/cdn-cgi/image/width=80,quality=75/uploads/avatar1.jpg

Is there a reason they choose to have those options in the path vs. as a query parameter?
Anything I should keep in mind regarding headers or the server-side implementation on cloudflare? Any examples out there to look at?

DanVilela•4/5/24, 2:02 PM

Hey guys, I just allowed public acces to my R2 bucket but still getting an 404.. Anyone know whats up? Couldnt figure out by the doics

DanVilela•4/5/24, 2:13 PM

I see. thanks!

VVenkat Dinavahi in their example they have something like: /cdn-cgi/image/width=80,quality=75/up...

zach•4/5/24, 6:33 PM

paths can always be cached and querystrings can be ignored for cache

zach•4/5/24, 6:34 PM

a URL is a resource locator — it tells where an exact resource is. If the resource is different even with the same path, is it a uniform resource locator?

zach•4/5/24, 6:34 PM

(tl;dr is that it's probably for caching

Busslina•4/5/24, 6:43 PM

Hi guys. Seems not possible to create a folder manually