is object versioning a thing in r2 aswell?

KinuOP•12/6/22, 12:17 PM

Requests with the header x-amz-acl: public-read are no longer rejected.Requests with the header x-amz-acl: public-read are no longer rejected.
This change was the most important change for me to switch to r2

KKinu is object versioning a thing in r2 aswell?

zegevlier•12/6/22, 12:28 PM

Not at the moment, but I believe it's something that they want to add

zegevlier•12/6/22, 12:28 PM

?r2-roadmap

Flare•12/6/22, 12:28 PM

These features are now available!!
- Public buckets, with custom domains: https://developers.cloudflare.com/r2/data-access/public-buckets/#enable-public-access-for-your-bucket
- Presigned URLs in the S3-compatible API

Future roadmap
Read more: https://blog.cloudflare.com/r2-ga/
- Object Lifecycles
- Jurisdictional Restrictions (e.g. 'EU')
- Live Migration without Downtime (S3->R2)

zegevlier•12/6/22, 12:29 PM

I might have that confused with object lifecycles

kian•12/6/22, 12:29 PM

both are on the roadmap

kian•12/6/22, 12:29 PM

r2 was built w/ versions in mind since the beginning, but the current object.versionobject.version has no meaning as previous versions aren't recorded

KinuOP•12/6/22, 2:02 PM

r2 have acls?

kian•12/6/22, 2:04 PM

Not yet

EEduardLeap if I understand the user agreement correctly we can't cache it because we use vi...

zegevlier•12/6/22, 3:01 PM

You can actually cache video if it comes from R2! Your account might be temporarily blacklisted from serving video (with this warning message), but if you contact support they can remove the restriction. Keep in mind there is a limit to max file size you can cache on the different plans, but if you're below that you should be good.

zegevlier•12/6/22, 3:02 PM

For reference, ToS and non-HTML content

ItsJulian•12/6/22, 3:03 PM

Is it possible to upload a folder/a set of files to an R2 bucket using wrangler?

kian•12/6/22, 3:04 PM

wrangler's R2 coverage is very basic

kian•12/6/22, 3:04 PM

would recommend rclone for that

ItsJulian•12/6/22, 3:04 PM

ah okay thanks, it's just a simple html test report in my ci/cd

ItsJulian•12/6/22, 3:04 PM

so I will use a s3 node package then

ItsJulian•12/6/22, 3:04 PM

thanks for the fast reaction

kian•12/6/22, 3:05 PM

wrangler could probably do a folder - it basically uses the same API as the dashboard

kian•12/6/22, 3:05 PM

but that's not currently in the functionality

EEduardLeap if I understand the user agreement correctly we can't cache it because we use vi...

kian•12/6/22, 3:05 PM

can cache? yes

might trigger anti-abuse rules? also yes

can reply that you are using R2 and have that lifted? also yes

kian•12/6/22, 3:06 PM

you can also get in touch with support ahead of time for your account to be 'exempt' from the aforementioned anti-abuse robot if you're using R2 at that scale

kian•12/6/22, 3:15 PM

the agreements themselves don't specify that you can use cache when using developer platform products for storage (KV, DO and R2) and some customers have reported that they've got their videos redirected to the anti-abuse placeholder.

cache is allowed when using KV/DO/R2 to serve non-HTML content, but that's not in the legalese writing - only ad-hoc confirmed by Cloudflare management here or on Twitter - and the automatic anti-abuse isn't the smartest.

you can ask support ahead of time, or decide to wait until it's in writing.

ItsJulian•12/6/22, 5:00 PM

When I open a html file, it downloads it instead of opening it as a webpage

ItsJulian•12/6/22, 5:01 PM

do I need to provide any options or so when uploading?

ItsJulian•12/6/22, 5:01 PM

I am using the aws-sdk for nodejs

kian•12/6/22, 5:01 PM

content-type should be enough

beelzabub•12/6/22, 8:26 PM

Hi all. I wrote up a basic, unofficial, command-line tool to make experimenting with the S3 interface of R2 a little bit simpler: https://github.com/vlovich/r2cli. In particular, the --presign--presign option should be much easier to explore how to use presigned URLs (it prints a copy-pastable

curl

curl

command for you).

I haven't figured out how to package it to publish on npm so if anyone can help with that piece I'd greatly appreciate it. The main obstacle is keytarkeytar which I'm not sure how to do - it's used to make sure that your creds are stored in your OS's secure storage instead of a naked file on disk. For now you'll have to clone & configure the repository manually (there's a READMEREADME describing how to do that).

Currently this is focused just on making it easy to test out the S3 API and also serves as a comprehensive example of how to use the v3 AWS JS SDK. It's not intended to cover rclonerclone use-cases which is an excellent tool and more of a general filesystem <> object store sync utility.

Please feel free to open issues/PRs on the issue tracker. I'll reiterate this is not an official cloudflare project yet but we decided it's useful to release as a preview under my own personal github for people to play around with.

cc @phillip

AAmby hi @beelzabub what is the current status on this? 3 9s for availability is not s...

beelzabub•12/6/22, 8:29 PM

I'm not aware of any competing service that offers a higher SLA. Do you have a competitor in mind?

Re TTFB I think it's generally in good shape. I believe there's some ongoing work to let you specify region hints (so that you can programatically control specify a performance hint about where you want the bucket to live) and there's some work I'm hoping that will land soon (weeks to months hopefully assuming things go smoothly) that will halve the TTFB of cross-region requests (e.g. request originates in San Francisco but the bucket lives in Europe).

If you have any specific performance concerns I'd recommend escalating a CUSTESC with support / pinging someone here.

Bbeelzabub I'm not aware of any competing service that offers a higher SLA. Do you have a c...

beelzabub•12/6/22, 8:33 PM

Also I'm not working on R2 anymore so it may be better to direct specific questions to @mnewswanger / @phillip / @codygriffin instead.

AAmby i'm not sure if block storage might be a better solution for us. The files are r...

beelzabub•12/6/22, 8:33 PM

Do you need strong consistency?

beelzabub•12/6/22, 8:34 PM

No KV

beelzabub•12/6/22, 8:34 PM

Yup

beelzabub•12/6/22, 8:37 PM

I'm working on making KV have a bounded consistency and also "instant" TTFB. All keys will have a guarantee of 1 minute consistency for read after write and the TTL setting will change to mean something different. Currently the consistency guarantees can be pretty weak in the worst case and performance can be highly variable depending on your access patterns.

is object versioning a thing in r2 aswell?

Similar Threads

Similar Threads

Similar Threads