Hi there I'm switching from Azure to R3 and have difficulties understanding how to use the API I've

Mmartinratinaud Hi there I'm switching from Azure to R3 and have difficulties understanding how ...

E

Erisa•7/14/23, 10:10 AM

Hi,

Also, I do not get why there is a whole part on S3 in the doc? Is it just that it is the exact same signature or will files actually be put on S3

R2 serves an S3-compatible API, the data will be on R2 but the signature and API are the same as S3 so any S3-compatible libraries will work

And finally, is there a Node JS SDK that would ease the use, I could not find an official one

We provide official examples for

aws-sdk-js

aws-sdk-js

aws-sdk-js

aws-sdk-js: https://developers.cloudflare.com/r2/examples/aws/aws-sdk-js/

aws-sdk-js-v3

aws-sdk-js-v3

aws-sdk-js-v3

aws-sdk-js-v3: https://developers.cloudflare.com/r2/examples/aws/aws-sdk-js-v3/

aws4fetch

aws4fetch

aws4fetch

aws4fetch: https://developers.cloudflare.com/r2/examples/aws/aws4fetch/

But theoretically any library compatible with S3 and that supports changing the endpoint will work fine since the API is compatible

EErisa Hi, > Also, I do not get why there is a whole part on S3 in the doc? Is it just...

M

martinratinaudOP•7/14/23, 10:59 AM

Thanks I did find the wording obvious but it works now

U

Unsmart•7/14/23, 6:59 PM

Dont think you can. Could use a worker + the cache API though

T

Tanjirokamado•7/14/23, 8:11 PM

Can I stream video from R2 storage in my web site using workers and what will be the limitation

U

Unsmart•7/14/23, 8:59 PM

Yes you can use R2 for video content

K

Kvothe•7/14/23, 10:18 PM

r2 not working in safari. cannot access links. does anyone have a solution to this situation?

KKvothe r2 not working in safari. cannot access links. does anyone have a solution to th...

C

Chaika•7/14/23, 10:23 PM

That's really vague, what's not working? The dashboard, the r2.dev public bucket, a public bucket on a custom domain? What error?

CChaika That's really vague, what's not working? The dashboard, the r2.dev public bucket...

K

Kvothe•7/14/23, 10:24 PM

I am sorry. I'm posting a video stream. https://cdn.anizium.com/demon-slayer-1-1-2160-jp.mp4 is my sample link. It works fine in all browsers, but I get an error on iOS devices.

K

Kvothe•7/14/23, 10:25 PM

I read in a few places that it might be related to cors policy.

C

Chaika•7/14/23, 10:27 PM

If you're going to the mp4 directly and not trying to load it on an external site it's not related, it doesn't load for me in Firefox either, looks like the mp4 is somehow corrupt or just unreadable by mozilla's mp4 as well

E

Erisa•7/14/23, 10:27 PM

Its 1.47 GB and cacheable, I wonder if its the cache bug mentioned a couple times in this channel

E

Erisa•7/14/23, 10:28 PM

try bypassing cache for that route

EErisa Its 1.47 GB and cacheable, I wonder if its the cache bug mentioned a couple time...

K

Kvothe•7/14/23, 10:31 PM

but it works for me and it's ok. I don't think this has anything to do with caching. I couldn't find the problem either.

U

Unsmart•7/14/23, 10:31 PM

Im assuming safari/firefox do range requests on mp4 files which would make it a cache issue

E

Erisa•7/14/23, 10:32 PM

in chromium it works but the range requests dont, I suspect^ the other browsers are relying on this behaviour

CChaika If you're going to the mp4 directly and not trying to load it on an external sit...

K

Kvothe•7/14/23, 10:32 PM

Can you try from chrome? I'm working too. I do not think that there will be a problem due to the file or the installation. If you wish, I can download bunny.mp4 and try it.

E

Erisa•7/14/23, 10:32 PM

Its because the file is too big to be cacheable, please bypass cache for it

K

Kvothe•7/14/23, 10:33 PM

how do i bypass the cache?

E

Erisa•7/14/23, 10:33 PM

https://developers.cloudflare.com/cache/how-to/cache-rules/#create-cache-rules-in-the-dashboard

Cache Rules (beta) · Cloudflare Cache (CDN) docs

Use Cache Rules to customize cache properties of your HTTP requests. For example, create a rule to specify how long to cache a resource in the …

K

Kvothe•7/14/23, 10:34 PM

We can find out about the problem here. I'll skip the cache by the way, that's on my mind. https://cdn.anizium.com/Big_Buck_Bunny_1080_10s_30MB.mp4 there is a small image in this link. i am getting the same error.

E

Erisa•7/14/23, 10:35 PM

That second link works for me on both Firefox and Safari iOS without any errors

E

Erisa•7/14/23, 10:35 PM

this is because its small and fits within the cache

E

Erisa•7/14/23, 10:35 PM

as seen by

< CF-Cache-Status: HIT

< CF-Cache-Status: HIT

< CF-Cache-Status: HIT

< CF-Cache-Status: HIT

K

Kvothe•7/14/23, 10:42 PM

yes you were right. thanks a lot. but this page is very detailed... and I don't know that much.. can I get some more help?

V

vassbence•7/15/23, 11:32 AM

My tests using

unstable_dev()

unstable_dev()

unstable_dev()

unstable_dev() and R2 fail in CI. Has anyone seen something similar? Sadly giving a longer timeout for the test doesn't seem to fix the problem. The test finishes in local in

24ms

24ms

24ms

24ms

S

Soham•7/15/23, 3:07 PM

does caching occur if the contents of R2 are accessed through a worker with a route?

K

kian•7/15/23, 3:41 PM

Nope

K

kian•7/15/23, 3:41 PM

You can add the Cache API yourself but you'd still be billed for the Worker invocation

S

Soham•7/15/23, 5:36 PM

ah ok

K

Kvothe•7/15/23, 10:27 PM

I am writing this with my apologies as I have no knowledge of it. what i want is to turn off cache and play high gb files in r2. but I don't understand what to do here. Do I connect with api or in the form of a subdomain?

KKvothe I am writing this with my apologies as I have no knowledge of it. what i want is...

C

Chaika•7/15/23, 11:06 PM

Under incoming requests match, Field:

Hostname

Hostname

Hostname

Hostname Operator

equals

equals

equals

equals, Value:

cdn.anizium.com

cdn.anizium.com

cdn.anizium.com

cdn.anizium.com
Cache Status: Bypass
Give it some name and save

C

Chaika•7/15/23, 11:08 PM

You could make a more complex rule, perhaps only bypassing for a specific subfolder (i.e Path Starts With /videos) or even specific files with a full path match, so that you only bypass cache for large videos. Although if everything you have is large videos it won't matter

CChaika Under incoming requests match, Field: `Hostname` Operator `equals`, Value: `cdn....

K

Kvothe•7/15/23, 11:22 PM

Thank you. but my problem still persists. it does not open or stream large videos in any way.
example:https://cdn.anizium.com/demon-slayer-1-1-2160-jp.mp4 its not working safari and firefox.

K

Kvothe•7/15/23, 11:22 PM

but there is no problem in chrome.

KKvothe Thank you. but my problem still persists. it does not open or stream large video...

K

katopz•7/16/23, 2:06 AM

i think

content-type: video/mp4

content-type: video/mp4

content-type: video/mp4

content-type: video/mp4 is missing there, it appear download instead of vdo controller in safari

your link

your link

your link

your link

curl --head https://cdn.anizium.com/demon-slayer-1-1-2160-jp.mp4

HTTP/2 200 
date: Sun, 16 Jul 2023 02:01:00 GMT
content-length: 1470744471
accept-ranges: bytes
etag: "aa6b6c5574dae8c617a95f2276f4b83f-15"
last-modified: Thu, 13 Jul 2023 18:53:36 GMT
vary: Accept-Encoding
cf-cache-status: DYNAMIC
report-to: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report\/v3?s=dWCevrvRNhRunMUndes9HR4XqNed4d5sLj9qfopVHdKf9qG8u9F7qnslbGJaLoY0figpGm9wo%2BnRwBhi0YJiDi9EskSQvaqo3tGD9apV8fdtEk%2FvtA02V2VDXkE0O2ZfNFk%3D"}],"group":"cf-nel","max_age":604800}
nel: {"success_fraction":0,"report_to":"cf-nel","max_age":604800}
server: cloudflare
cf-ray: 7e76a7a0292945b4-BKK
alt-svc: h3=":443"; ma=86400

curl --head https://cdn.anizium.com/demon-slayer-1-1-2160-jp.mp4

HTTP/2 200 
date: Sun, 16 Jul 2023 02:01:00 GMT
content-length: 1470744471
accept-ranges: bytes
etag: "aa6b6c5574dae8c617a95f2276f4b83f-15"
last-modified: Thu, 13 Jul 2023 18:53:36 GMT
vary: Accept-Encoding
cf-cache-status: DYNAMIC
report-to: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report\/v3?s=dWCevrvRNhRunMUndes9HR4XqNed4d5sLj9qfopVHdKf9qG8u9F7qnslbGJaLoY0figpGm9wo%2BnRwBhi0YJiDi9EskSQvaqo3tGD9apV8fdtEk%2FvtA02V2VDXkE0O2ZfNFk%3D"}],"group":"cf-nel","max_age":604800}
nel: {"success_fraction":0,"report_to":"cf-nel","max_age":604800}
server: cloudflare
cf-ray: 7e76a7a0292945b4-BKK
alt-svc: h3=":443"; ma=86400

curl --head https://cdn.anizium.com/demon-slayer-1-1-2160-jp.mp4

HTTP/2 200 
date: Sun, 16 Jul 2023 02:01:00 GMT
content-length: 1470744471
accept-ranges: bytes
etag: "aa6b6c5574dae8c617a95f2276f4b83f-15"
last-modified: Thu, 13 Jul 2023 18:53:36 GMT
vary: Accept-Encoding
cf-cache-status: DYNAMIC
report-to: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report\/v3?s=dWCevrvRNhRunMUndes9HR4XqNed4d5sLj9qfopVHdKf9qG8u9F7qnslbGJaLoY0figpGm9wo%2BnRwBhi0YJiDi9EskSQvaqo3tGD9apV8fdtEk%2FvtA02V2VDXkE0O2ZfNFk%3D"}],"group":"cf-nel","max_age":604800}
nel: {"success_fraction":0,"report_to":"cf-nel","max_age":604800}
server: cloudflare
cf-ray: 7e76a7a0292945b4-BKK
alt-svc: h3=":443"; ma=86400

curl --head https://cdn.anizium.com/demon-slayer-1-1-2160-jp.mp4

HTTP/2 200 
date: Sun, 16 Jul 2023 02:01:00 GMT
content-length: 1470744471
accept-ranges: bytes
etag: "aa6b6c5574dae8c617a95f2276f4b83f-15"
last-modified: Thu, 13 Jul 2023 18:53:36 GMT
vary: Accept-Encoding
cf-cache-status: DYNAMIC
report-to: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report\/v3?s=dWCevrvRNhRunMUndes9HR4XqNed4d5sLj9qfopVHdKf9qG8u9F7qnslbGJaLoY0figpGm9wo%2BnRwBhi0YJiDi9EskSQvaqo3tGD9apV8fdtEk%2FvtA02V2VDXkE0O2ZfNFk%3D"}],"group":"cf-nel","max_age":604800}
nel: {"success_fraction":0,"report_to":"cf-nel","max_age":604800}
server: cloudflare
cf-ray: 7e76a7a0292945b4-BKK
alt-svc: h3=":443"; ma=86400

expected (working one)

expected (working one)

expected (working one)

expected (working one)

curl --head https://freetestdata.com/wp-content/uploads/2022/02/Free_Test_Data_1MB_MP4.mp4     
HTTP/2 200 
date: Sun, 16 Jul 2023 02:02:57 GMT
content-type: video/mp4
content-length: 1053887
cache-control: public, max-age=31536000
expires: Mon, 15 Jul 2024 02:02:57 GMT
last-modified: Fri, 18 Feb 2022 14:02:30 GMT
etag: "1014bf-620fa6f6-0;;;"
referrer-policy: no-referrer-when-downgrade
x-turbo-charged-by: LiteSpeed
cf-cache-status: MISS
accept-ranges: bytes
report-to: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report\/v3?s=RvC%2Bm3P3Emi2CzAAtMKugWEfauM9WOViK%2FI%2BsBK53CZud%2F5ssuhJzW8pZxog48h73SpCIB3QC1pWRnT7veZn%2BbbaMAgic%2Bp6GrLqUVW0IbGOCugxVYRcz9Lb9j1CAyBebczR"}],"group":"cf-nel","max_age":604800}
nel: {"success_fraction":0,"report_to":"cf-nel","max_age":604800}
server: cloudflare
cf-ray: 7e76aa7779f945ac-BKK
alt-svc: h3=":443"; ma=86400

curl --head https://freetestdata.com/wp-content/uploads/2022/02/Free_Test_Data_1MB_MP4.mp4     
HTTP/2 200 
date: Sun, 16 Jul 2023 02:02:57 GMT
content-type: video/mp4
content-length: 1053887
cache-control: public, max-age=31536000
expires: Mon, 15 Jul 2024 02:02:57 GMT
last-modified: Fri, 18 Feb 2022 14:02:30 GMT
etag: "1014bf-620fa6f6-0;;;"
referrer-policy: no-referrer-when-downgrade
x-turbo-charged-by: LiteSpeed
cf-cache-status: MISS
accept-ranges: bytes
report-to: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report\/v3?s=RvC%2Bm3P3Emi2CzAAtMKugWEfauM9WOViK%2FI%2BsBK53CZud%2F5ssuhJzW8pZxog48h73SpCIB3QC1pWRnT7veZn%2BbbaMAgic%2Bp6GrLqUVW0IbGOCugxVYRcz9Lb9j1CAyBebczR"}],"group":"cf-nel","max_age":604800}
nel: {"success_fraction":0,"report_to":"cf-nel","max_age":604800}
server: cloudflare
cf-ray: 7e76aa7779f945ac-BKK
alt-svc: h3=":443"; ma=86400

curl --head https://freetestdata.com/wp-content/uploads/2022/02/Free_Test_Data_1MB_MP4.mp4     
HTTP/2 200 
date: Sun, 16 Jul 2023 02:02:57 GMT
content-type: video/mp4
content-length: 1053887
cache-control: public, max-age=31536000
expires: Mon, 15 Jul 2024 02:02:57 GMT
last-modified: Fri, 18 Feb 2022 14:02:30 GMT
etag: "1014bf-620fa6f6-0;;;"
referrer-policy: no-referrer-when-downgrade
x-turbo-charged-by: LiteSpeed
cf-cache-status: MISS
accept-ranges: bytes
report-to: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report\/v3?s=RvC%2Bm3P3Emi2CzAAtMKugWEfauM9WOViK%2FI%2BsBK53CZud%2F5ssuhJzW8pZxog48h73SpCIB3QC1pWRnT7veZn%2BbbaMAgic%2Bp6GrLqUVW0IbGOCugxVYRcz9Lb9j1CAyBebczR"}],"group":"cf-nel","max_age":604800}
nel: {"success_fraction":0,"report_to":"cf-nel","max_age":604800}
server: cloudflare
cf-ray: 7e76aa7779f945ac-BKK
alt-svc: h3=":443"; ma=86400

curl --head https://freetestdata.com/wp-content/uploads/2022/02/Free_Test_Data_1MB_MP4.mp4     
HTTP/2 200 
date: Sun, 16 Jul 2023 02:02:57 GMT
content-type: video/mp4
content-length: 1053887
cache-control: public, max-age=31536000
expires: Mon, 15 Jul 2024 02:02:57 GMT
last-modified: Fri, 18 Feb 2022 14:02:30 GMT
etag: "1014bf-620fa6f6-0;;;"
referrer-policy: no-referrer-when-downgrade
x-turbo-charged-by: LiteSpeed
cf-cache-status: MISS
accept-ranges: bytes
report-to: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report\/v3?s=RvC%2Bm3P3Emi2CzAAtMKugWEfauM9WOViK%2FI%2BsBK53CZud%2F5ssuhJzW8pZxog48h73SpCIB3QC1pWRnT7veZn%2BbbaMAgic%2Bp6GrLqUVW0IbGOCugxVYRcz9Lb9j1CAyBebczR"}],"group":"cf-nel","max_age":604800}
nel: {"success_fraction":0,"report_to":"cf-nel","max_age":604800}
server: cloudflare
cf-ray: 7e76aa7779f945ac-BKK
alt-svc: h3=":443"; ma=86400

K

kian•7/16/23, 10:27 PM

So, yes, it does expose my bucket name and the account ID. Is that safe? Bucket name doesn't seem to be a big deal as it's same as my domain. But is ACCOUNT_ID safe to be exposed?

Yes, it's fine.

Note that I do have Custom Domains setup on this bucket. Can I just replace the BUCKET_NAME.ACCOUNT_ID.r2.cloudflarestorage.com part of the presigned url with my custom domain? Would that still validate the signature?

Nope, custom domains don't implement the S3 API.

A

ariesclark•7/17/23, 8:20 AM

Can you get an object's specific version?

U

Unsmart•7/17/23, 8:36 AM

There’s no versions

UUnsmart There’s no versions

A

ariesclark•7/17/23, 9:02 AM

Objects do have versions :)

A

ariesclark•7/17/23, 9:04 AM

https://developers.cloudflare.com/r2/api/workers/workers-api-reference/#r2object-definition

Workers API reference · Cloudflare R2 docs

The in-Worker R2 API is accessed by binding an R2 bucket to a Worker. The Worker you write can expose external access to buckets via a route or …

A

ariesclark•7/17/23, 9:05 AM

Available under the

version

version

version

version key, please don't provide wrong feedback.

K

kian•7/17/23, 9:05 AM

He’s not wrong.

K

kian•7/17/23, 9:05 AM

It’s a placeholder that isn’t recorded, it’s just there to support versioning in the future

Kkian It’s a placeholder that isn’t recorded, it’s just there to support versioning *i...

A

ariesclark•7/17/23, 9:14 AM

Again, this is also wrong, versions change when you replace an existing file.

A

ariesclark•7/17/23, 9:17 AM

I suppose I could mimic object versions using the Cache API though.

Z

zegevlier•7/17/23, 9:18 AM

What do you want the version information for? Only the latest upload under a key is stored.

Hi there I'm switching from Azure to R3 and have difficulties understanding how to use the API I've

Similar Threads