Hello, Cloudflare Team. I have a question about Cloudflare R2. I want to open all Buckets and Files

Hello, Cloudflare Team.

I have a question about Cloudflare R2.
I want to open all Buckets and Files via S3 Client i.e. S3 Browser. However, when I try it it generates an error.

Is this an error from Cloudflare or from S3 Browser?
Then, is there an S3 Client that can access Cloudflare R2?

Thank You.

AzickriOP•7/18/23, 8:03 AM

Hello, Cloudflare Team.

I've found an S3 Client that can access Cloudflare R2.
It's called CyberDuck https://cyberduck.io/

Thank You.

Cyberduck | Libre server and cloud storage browser for Mac and Wind...

Sam•7/18/23, 10:30 AM

You could create HLS stream files and upload it to R2

AAzickri Hello, Cloudflare Team. I have a question about Cloudflare R2. I want to open a...

PencilNavigator•7/18/23, 11:47 AM

WinSCP wasn't working long time ago and i reported, there were no replies

Erisa•7/18/23, 11:53 AM

Could you try again (with WinSCP)? R2 made a number of compatbility improvements in the last year and I'd be curious what issues its stiill having if any

AAzickri Hello, Cloudflare Team. I have a question about Cloudflare R2. I want to open a...

Erisa•7/18/23, 11:54 AM

Its an error from Cloudflare telling you that it doesn't support the auth scheme that S3 Browser is trying to use. Does the application have an option to use V4 auth instead?

EErisa Could you try again (with WinSCP)? R2 made a number of compatbility improvements...

PencilNavigator•7/18/23, 11:58 AM

i tried recently and it doesn't work

Erisa•7/18/23, 11:59 AM

Any idea what error it gives? Or just generic?

PencilNavigator•7/18/23, 11:59 AM

"The request signature we calculated does not match the signature you provided. Check your secret access key and signing method."

Erisa•7/18/23, 11:59 AM

I see

Erisa•7/18/23, 11:59 AM

Thanks

PencilNavigator•7/18/23, 12:00 PM

i've regenrated 10+ times the credentals and no it doesn't fix the issue

PencilNavigator•7/18/23, 12:00 PM

every time when it reaches 5120KB it stops and pops this error

PencilNavigator•7/18/23, 12:01 PM

i am on the latest version of WinSCP

Erisa•7/18/23, 12:01 PM

Ah, probably something to do with multipart then

PencilNavigator•7/18/23, 12:01 PM

dunno

PencilNavigator•7/18/23, 12:02 PM

uploading to b2 works, s3 works, only r2 is not (with this error)

vassbence•7/18/23, 12:06 PM

Is there a speed difference between accessing the bucket via a public url and from a worker?

vassbence•7/18/23, 12:07 PM

Or rather, should there be a difference? I'm seeing lower latencies across the board when accessing files from inside a Worker

vassbence•7/18/23, 12:07 PM

What could be the reason behind it?

Erisa•7/18/23, 12:10 PM

Its expected that Workers will have lower latency but the difference shouldnt be too dramatic - what numbers are you seeing? And is it tested from the same regions?

vassbence•7/18/23, 12:13 PM

blue: worker
gray: public url

vassbence•7/18/23, 12:14 PM

it's not too dramatic tbh, i just wanted to know the fastest possible option

vassbence•7/18/23, 12:15 PM

i'm curious, why is it faster via a Worker? Doesnt the worker itself add like 30ms latency? Or with the worker the request gets on the cf backbone faster?

Erisa•7/18/23, 12:15 PM

Workers dont add 30ms latency to requests

Erisa•7/18/23, 12:16 PM

If I recall correctly I believe it was something to do with the binding not having as much auth overhead, like for S3 you have to sign the request and then verify the signature and all that stuff because the request goes through

Erisa•7/18/23, 12:17 PM

Public URL I'm not so sure on

vassbence•7/18/23, 12:17 PM

Seems like a valid explanation yeah..

How much overhead do workers add to a request? I mean it can't possibly be 0

vassbence•7/18/23, 12:18 PM

https://blog.cloudflare.com/cloudflare-workers-the-fast-serverless-platform/ this shows around 20ms TTFB in US regions

vassbence•7/18/23, 12:20 PM

Also, based on these outcomes should I just serve my files via Worker and not a public URL?

DaniFoldi•7/18/23, 12:20 PM

20ms sounds about right, the worker is loaded while TLS handshake & validation and everything is performed, so you don't really see the cold starts as much

vassbence•7/18/23, 12:23 PM

I just ran an artillery load test too, and files via workers is almost 2x.. guess i'll disable the public url and serve assets via workers