The way I understood the messages, it would be public through the CNAME (your custom domain) but not

The way I understood the messages, it would be public through the CNAME (your custom domain) but not public through the r2.cloudflarestorage.com endpoint

ErisaOP•6/29/22, 8:43 PM

And on Cloudflare you can configure Workers to run in front of your domains so that they always execute before whatever the CNAME points to

EErisa And on Cloudflare you can configure Workers to run in front of your domains so t...

musicman123 — FJLaboratories•6/29/22, 8:44 PM

Oh so you CAN actually put a worker in front of a cname didn’t realize that

ErisaOP•6/29/22, 8:44 PM

You can put a Worker in front of anything using a route

musicman123 — FJLaboratories•6/29/22, 8:45 PM

Right yea. I forgot workers took priority! doh!

ErisaOP•6/29/22, 8:45 PM

Once its in place theres no way for someone to bypass it, the Worker will always run for that request and you can use it to dictate what to serve to who

musicman123 — FJLaboratories•6/29/22, 8:45 PM

I even have that going already with a CNAME routed worker

musicman123 — FJLaboratories•6/29/22, 8:45 PM

Can the worker then access the underlying CNAME then?

musicman123 — FJLaboratories•6/29/22, 8:45 PM

Never had the personal need for it since I always did a dummy CNAME target

ErisaOP•6/29/22, 8:45 PM

Yes, it can fetch the underlying CNAME like normal

musicman123 — FJLaboratories•6/29/22, 8:46 PM

Neat!

ErisaOP•6/29/22, 8:46 PM

When a Worker fetches its own URL it fetches whatever is configured to be underneath

musicman123 — FJLaboratories•6/29/22, 8:46 PM

This is news to me. Thanks!

ErisaOP•6/29/22, 8:46 PM

Normally your Worker would get in a request, you would then perform checks or modify that request and then fetch it and return the result

Meowcat285•6/29/22, 9:17 PM

Quick question, so what do you think about using R2 for an Unreal Engine S3 Shared Derived Data Cache (https://docs.unrealengine.com/4.27/en-US/ProductionPipelines/DerivedDataCache/#q:whatisthes3ddc?) ? Will be be expensive due to a large ammount of requests?

Meowcat285•6/29/22, 9:18 PM

I am currently using a self hosted S3 compatible server for this, but the distrubited nature of R2 makes it very apealing

Meowcat285•6/29/22, 9:21 PM

Another worry is that it may not support the S3 API call ListObjects, but that seems to have a fallback

EErisa The way I understood the messages, it would be public through the CNAME (your cu...

beelzabub•6/29/22, 9:25 PM

You would actually be able to either or:

Totally public
Access restricted through an allow list of CNames (probably up to 100 or 1k - need to figure out what makes sense)

Totally public doesn't preclude putting a CName in front but then you have to contend with auth in the sense that if your public bucket ID leaks somehow, then you've got no auth. However, as long as you keep the public ID secret and use a Cloudflare-managed CName you should be "OK". It's security through obscurity but a Cloudflare CName will mask your public bucket ID. Public bucket IDs have a flat globally unique domain that you can't figure out the underlying account/bucket name for. The mapping back & forth is internal to Cloudflare. The public bucket is a randomly generated UUID string and indeterminable even if you somehow knew the account / bucket name (so all the community members posting their account IDs, it won't give attackers any information about what the public name of that bucket is & there's no way to brute force it).

MMeowcat285 Another worry is that it may not support the S3 API call ListObjects, but that s...

beelzabub•6/29/22, 9:26 PM

We definitely support ListObjects

MMeowcat285 Quick question, so what do you think about using R2 for an Unreal Engine S3 Shar...

beelzabub•6/29/22, 9:27 PM

How many requests are we talking about? Pricing is here: https://developers.cloudflare.com/r2/platform/pricing/

Pricing · Cloudflare R2 docs

Store large amounts of unstructured data without egress fees.

beelzabub•6/29/22, 9:27 PM

Putting cache in front of it would reduce the price since cached results wouldn't be billed.

Cyb3r-Jak3•6/29/22, 10:00 PM

Is there a plan to add R2 endpoint to the REST API?

beelzabub•6/29/22, 10:02 PM

By REST API, do you mean APIv4?

Cyb3r-Jak3•6/29/22, 10:03 PM

Yes

beelzabub•6/29/22, 10:04 PM

It's actually there already. That's what the UI uses underneath and it's fairly complete (the primary users are UI & wrangler). There aren't plans any time soon to actually stabilize and document it though.

Cyb3r-Jak3•6/29/22, 10:07 PM

Yeah I've been inspecting it but wanted to use terraform to manage buckets.

beelzabub•6/29/22, 10:11 PM

Which actions specifically do you need?

Cyb3r-Jak3•6/29/22, 10:37 PM

Pretty much just create and delete

beelzabub•6/29/22, 10:37 PM

I doubt we'd change that

Cyb3r-Jak3•6/29/22, 10:38 PM

And API token creation and delete

kian•6/29/22, 10:38 PM

I think the TF provider relies on them being in cloudflare-go

kian•6/29/22, 10:38 PM

Should(?) be easy enough to add those in though

Kkian I think the TF provider relies on them being in cloudflare-go

Cyb3r-Jak3•6/29/22, 10:38 PM

It does which requires them to have a public API

beelzabub•6/29/22, 10:38 PM

R2 API token creation/deletion is the same as stock API token creation/deletion. The only nuance is that the token id is sha256 of the normal token id

kian•6/29/22, 10:39 PM

My R2 has disappeared from the dashboard - huh

Kkian My R2 has disappeared from the dashboard - huh

Cyb3r-Jak3•6/29/22, 10:39 PM

https://giphy.com/gifs/FootballAustralia-soccer-referee-red-card-TbRwmI2fHg6ELPObHH

GiphyFootball Australia