Do you know if Cloudflare has a relative product to Cloudfront uploads, where Cloudfront handles the

Do you know if Cloudflare has a relative product to Cloudfront uploads, where Cloudfront handles the upload into the S3 bucket? I've forgotten the name.

Karew•1/13/23, 8:30 AM

I'm not sure what you mean by that

defido 👊⛽OP•1/13/23, 8:30 AM

I actually don't think they have a name for it, but Cloudfront takes a POST request and redirects the input into S3, meaning the upload is MUCH faster.

https://docs.aws.amazon.com/AmazonS3/latest/userguide/transfer-acceleration.html

Configuring fast, secure file transfers using Amazon S3 Transfer Ac...

Get faster data transfers to and from Amazon S3 with Amazon S3 Transfer Acceleration.

Karew•1/13/23, 8:30 AM

Do you mean like pushing objects to the Cache?

defido 👊⛽OP•1/13/23, 8:30 AM

Found it

defido 👊⛽OP•1/13/23, 8:31 AM

Essentially the cloudfront acts a localised server that takes the input, and then uploads that to S3. Instead of uploading direct to S3 to reduce latency.

Karew•1/13/23, 8:31 AM

I don't think R2 has something like this. It will probably be more pertinent to just select the correct bucket location whenever they give us the ability to change the bucket location/distribution.

Karew•1/13/23, 8:31 AM

Selecting a location that is close to your app server or whatever is doing the uploads, that is

defido 👊⛽OP•1/13/23, 8:38 AM

Wonder if workers could act as a localised upload proxy, hmm

Original message was deleted

defido 👊⛽OP•1/13/23, 8:57 AM

I know that using a VPN i get directed to a localised bucket (when setting up a bucket), I can't confirm the upload difference, but I have EUR/USA/ASIA (They're in USA, London?, Singapore) buckets open right now, I could do a test to see if the speed difference is different to all three from my location. If they're all the same, then yes, cloudflare would be proxying upload, but I highly doubt it.

Ddefido 👊⛽Do you know if Cloudflare has a relative product to Cloudfront uploads, where Cl...

defido 👊⛽OP•1/13/23, 9:00 AM

This actually uploads to the local Cloudfront point, which then uploads to the S3 bucket. That's what I was wondering about. Technically of course Cloudflare can do that, just not sure if they did have a product like that.

defido 👊⛽OP•1/13/23, 9:14 AM

It's not scientific but I uploaded the same file to multiple R2 buckets that I know are in 3 different geophraphic locations (From Aus):

Singapore: 43 seconds

USA: 38 seconds

EU: 36 Seconds

Google Drive: 31 seconds

defido 👊⛽OP•1/13/23, 9:15 AM

And 1 lonely upload to USA for some reason just took way longer.

TThéo Hi, I'm having a problem with R2: my bucket is public, I can upload to it locall...

defido 👊⛽OP•1/13/23, 9:36 AM

Have you tried any cors settings in a worker infront of the bucket also?

defido 👊⛽OP•1/13/23, 9:37 AM

I believe public buckets made on the console still need to have cors settings added to them via the CLI

defido 👊⛽OP•1/13/23, 9:37 AM

Let me find it, all I know is every issue i've had with authorisation has always been related to CORS, but let me find this thing.

defido 👊⛽OP•1/13/23, 9:38 AM

https://developers.cloudflare.com/r2/data-access/public-buckets/#configure-cors-for-your-bucket

Public Buckets · Cloudflare R2 docs

Public Bucket is a feature that allows users to expose the contents of their R2 buckets directly to the internet. By default, buckets are never publicly …

TThéo Is it a common pattern to 401 for CORS?

defido 👊⛽OP•1/13/23, 9:40 AM

It is common to get 401 on CORS issues from setting up the wrong preflight or something else, and then also it could be the credentials as well. https://www.google.com/search?q=401+cors&oq=401+cors+&aqs=chrome..69i57j0i20i263i512j0i433i512j0i512j0i131i433i512j69i60l3.1448j0j4&sourceid=chrome&ie=UTF-8

defido 👊⛽OP•1/13/23, 9:44 AM

I don't see anything wrong with your code.

TThéo Huh TIL, I'm ruling out the credentials though as I've seen them to be strictly ...

defido 👊⛽OP•1/13/23, 9:44 AM

Oh you're going server to server.

TThéo Hi, I'm having a problem with R2: my bucket is public, I can upload to it locall...

defido 👊⛽OP•1/13/23, 9:46 AM

"I can upload to it locally" when you mean this, you mean you can upload directly from the browser console?

defido 👊⛽OP•1/13/23, 9:51 AM

The fact it's a public bucket won't change anything as you're using the S3 access point. It could be that the server isn't seeing the .env correctly, you can try console log it, run it on the server and see if it prints it out. If it does, that's not it, then I'd change the cors setup on the CLI for the bucket anyway. Then try it again without changing the code, if it fails, change the cors setup on the node side.

defido 👊⛽OP•1/13/23, 9:51 AM

I use workers infront of R2, not 100% sure of direct.

defido 👊⛽OP•1/13/23, 9:55 AM

I'd definitely check the CORS thing out, whitelist your domain, if not, then it might be a settings thing that the CDN is blocking, some obscure security feature.

defido 👊⛽OP•1/13/23, 9:56 AM

I know for example, I have R2+Workers behind the CF CDN with 'Cache everything' and sometimes it works, sometimes it doesn't, haven't worked out why yet.

kian•1/13/23, 9:56 AM

Workers run before the cache so Cache Everything will do nothing

defido 👊⛽OP•1/13/23, 9:57 AM

The worker only sets the range property for HLS deliveries, I've had it working before. Just forgot how I did it.

kian•1/13/23, 10:18 AM

There'll probably be a response body with the 401

kian•1/13/23, 10:25 AM

There'll be a debug or logger option for basically all of the SDKs

defido 👊⛽OP•1/13/23, 10:28 AM

https://wasabi-support.zendesk.com/hc/en-us/articles/360045730612-How-to-use-Wasabi-Policy-Generator#bucket-policy#1

https://docs.aws.amazon.com/AmazonS3/latest/userguide/example-bucket-policies.html

You reckon we might see S3 access policy profiles, like most object store companies have now started using?

Bucket policy examples - Amazon Simple Storage Service

See examples of typical use cases for Amazon S3 bucket policies.

Wasabi Knowledge Base

How to use Wasabi Policy Generator

Wasabi Policy Generator is a tool which allows users to create policies in a visual editor format and automatically creates JSON policies that drives access to Wasabi's resources.
This tool is simi...

NNekyo Hey! 🙂 we are seeing the same issue as this person, are these ssl errors a kno...

Vero•1/13/23, 2:12 PM

Hi @nekyo , i'm checking that

NNekyo Hey! 🙂 we are seeing the same issue as this person, are these ssl errors a kno...

Walshy•1/13/23, 2:13 PM

what's the domain you see this on?

Do you know if Cloudflare has a relative product to Cloudfront uploads, where Cloudfront handles the

Similar Threads

Similar Threads

Similar Threads