Cloudflare Developers•4y ago

That sounds great! So no avoiding paying the write rate for each object?

Bben That sounds great! So no avoiding paying the write rate for each object?

itsmatteomanf•3/29/22, 8:31 AM

From what I'm reading it looks to me it's still one write per object...

benOP•3/29/22, 8:32 AM

Alright, makes sense. Pretty darn cheap anyway haha

beelzabub•3/29/22, 5:27 PM

I don't know what the billing on a hypothetical API would be.

Laurent Pellegrino•3/29/22, 10:06 PM

Is R2 close to public beta?

lmtr0•3/29/22, 10:08 PM

thats one of the questions on the qna

lmtr0•3/29/22, 10:09 PM

no spoilers /s

James•3/29/22, 10:09 PM

I believe the most public ETA is beta in Q2 and GA in H2. Y'all are going to love it though

lmtr0•3/29/22, 10:10 PM

OK, I understood "I believe the most public" from the phrase.....
whats ETA, Q2, GA and H2?

lmtr0•3/29/22, 10:10 PM

Y'all are going to love it though

I think so

lmtr0•3/29/22, 10:10 PM

I mean

lmtr0•3/29/22, 10:11 PM

just the pricing is lovable

lmtr0•3/29/22, 10:11 PM

lmao

James•3/29/22, 10:11 PM

Sorry, beta in quarter 2 (April - Jun), and general availability in the second half of the year, July - Dec

James•3/29/22, 10:11 PM

That was the last publicly disclosed timeline, as far as I know

lmtr0•3/29/22, 10:11 PM

thankx

lmtr0•3/29/22, 10:12 PM

English is not my 1st lang so it's difficult to understand this stuff sorry

James•3/29/22, 10:12 PM

Absolutely no problem! Your english is great

I forget sometimes that most people don't know what GA, Q2, H2, etc. means

JJames Sorry, beta in quarter 2 (April - Jun), and general availability in the second h...

Isaac McFadyen•3/29/22, 10:13 PM

Yeah, that was the last I heard as well. From the CTO John Graham-Cumming on Twitter.

JJames Absolutely no problem! Your english is great 🙂 I forget sometimes that most peo...

Isaac McFadyen•3/29/22, 10:13 PM

TBH I only knew Q2 as well

Isaac McFadyen•3/29/22, 10:13 PM

But I assumed H2 must mean this year at some point

IIsaac McFadyen But I assumed H2 must mean this year at some point 🤷‍♂️

James•3/29/22, 10:14 PM

2nd half, yeah. And GA = general availability

James•3/29/22, 10:14 PM

If you're an ent customer though, definitely reach out to your CSM about testing!

JJames Absolutely no problem! Your english is great 🙂 I forget sometimes that most peo...

lmtr0•3/29/22, 10:15 PM

thx

JJames 2nd half, yeah. And GA = general availability

lmtr0•3/29/22, 10:15 PM

thx

andrew•3/29/22, 10:52 PM

regarding the feature that automatically pulls and expires objects from an existing s3 bucket, will that feature have object size limits?

beelzabub•3/30/22, 4:01 PM

I don't think it would.

beelzabub•3/30/22, 6:20 PM

Eventually yes. Automated object lifecycle management won't be something we have at open beta.

beelzabub•3/30/22, 6:22 PM

By eventually I mean the plan is sometime this year, not "indeterminate time in the future"

Aandrew regarding the feature that automatically pulls and expires objects from an exist...

beelzabub•3/30/22, 6:27 PM

I think the limit will be a bit under 5TB (more precisely ~5.3GB short of 5TB). It's on our roadmap to fix this limitation (which will also allow us to support files > 5TB).

beelzabub•3/30/22, 11:21 PM

It's on our roadmap but I don't know what shape it'll look like or what the timeline for that looks like.

What's the use-case your thinking of?

beelzabub•3/31/22, 12:34 AM

Ok. That's a bit different than what I was referring to which is cross account access for Cloudflare accounts. In this case it sounds like you have your own customers and they have accounts with you. What you would do is write a Worker to authorize the request (using whatever authorization mechanism you are using) to figure out which bucket the request has access to and then use the S3 API to upload to the right bucket.

Or you could make your life even easier and use a single bucket that's bound into your worker and your authorization is at the prefix level. Unlike S3 and other providers, buckets are organizational boundaries only. Each key will have roughly independent performance of any other key (within the bucket or in a different bucket). Same kind of thing will eventually apply to things like object lifecycles.

Of course you don't strictly need Workers. You could access R2 using the S3 endpoint from any server technology you want, just Workers will have the best performance and cost I think.

Is that helpful?

beelzabub•3/31/22, 12:47 AM

Gotcha. It sounds like you're looking for to build a SaaS product that provides a solution for each platform (ie. existing Azure Blobs, S3, and GCS customers use your product but manage buckets on the platform of their choice),. We don't yet have a good story for that use-case. I can't recall if that's on the roadmap for GA later this year. I think you'll find out more once we announce Open Beta.

beelzabub•3/31/22, 12:59 AM

Are you also needing requester pays billing on requests?

beelzabub•3/31/22, 1:00 AM

And what kind of access are you needing to the other account?

beelzabub•3/31/22, 1:01 AM

ie. read + write restricted to one bucket, read to one bucket, or is read+write to all buckets/read to all buckets sufficient?

beelzabub•3/31/22, 1:02 AM

For some reason I can't DM you.

Erwin•3/31/22, 1:11 AM

If you want those customers to give you access to one of their S3 buckets (or Azure/GCP equivalent), you can do that with regular API requests in a Worker..

beelzabub•4/1/22, 9:40 PM

Happy Friday everyone. As we're starting to head towards Open Beta, I just wanted to give you guys a sneak peek at the bindings we'll be publishing next week: https://gist.github.com/vlovich/9620194cd3e42a41e79d4cacbf1856ab

For users already onboarded in the private beta, you'll need to publish r2_public_beta_bindingsr2_public_beta_bindings sometime late next week (I'm not 100% sure when we'll allow such scripts - I'll keep you updated).

Please provide feedback. There's a few spots I've spotted:
R2ErrorR2Error stackstack is anyany instead of string (& in fact

name

name

/messagemessage/stackstack can probably be elided because of inheritance? not sure).
R2ErrorR2Error

code

code

needs a documentation note. This code is the same code that the Cloudflare V4 API that will be documented.
onlyIfonlyIf needs a documentation note. The HeadersHeaders it accepts require HTTP header names (IfModifiedSinceIfModifiedSince/IfNotModifiedSinceIfNotModifiedSince etc).
R2ObjectR2Object writeHttpMetadatawriteHttpMetadata is missing a note. It writes out the headers from httpMetadatahttpMetadata as you would expect (content-type, cache-control, etc)
Same goes for httpMetadatahttpMetadata on put (i.e. cache-controlcache-control -> cacheControlcacheControl, expiresexpires -> cacheExpirycacheExpiry). Note that S3 uses the HTTP "Expires" name but I think that confuses people into thinking that has something to do with lifecycle. It does not. It's simply the cache expiry metadata you associate with an object.
R2PutOptionsR2PutOptions has

md5

md5

and sha1sha1 as optionals to specify the digest of the body, but those are mutually exclusive and the type needs to be reified to reflect that (the runtime enforces this, it's just not reflected in the type system).

Enjoy everyone!

Gist

final r2 bindings.ts

GitHub Gist: instantly share code, notes, and snippets.

beelzabub•4/1/22, 9:44 PM

We've focused on a tight core set of functionality. The S3 API has some extra features currently (e.g. copy object, multipart uploads) but we wanted to keep the canvas a bit cleaner and make sure we kept good ergonomics for the API.

James•4/1/22, 9:53 PM

This is awesome! Content length is no longer a separate required argument to

put

put

it seems then - woot!

Walshy•4/1/22, 10:11 PM

No length anymore whooo

Isaac McFadyen•4/1/22, 10:25 PM

?r2

Flare•4/1/22, 10:25 PM

R2 is still in very early access, please do not ask to be added. There is no ETA for a public beta but watch out on the blog (https://blog.cloudflare.com/) or follow the #cloudflare-blog channel!

Isaac McFadyen•4/1/22, 10:25 PM

@raeesbhatti ^

JJames This is awesome! Content length is no longer a separate required argument to `pu...

beelzabub•4/1/22, 11:57 PM

You need to be careful though. The length of the ReadableStreamReadableStream must be known. For example, incoming request with a content-lengthcontent-length and you're forwarding along the body. Or the response body of a fetch that has a content-lengthcontent-length. Or the readable half of a FixedLengthStreamFixedLengthStream transform stream.

beelzabub•4/1/22, 11:58 PM

That is not a helpful bot. We're going to start opening things up for our loyal Discord users in advance of Open Beta. We're just trying to smooth out some rough edges right now that aren't fun.

That sounds great! So no avoiding paying the write rate for each object?

Similar Threads

Similar Threads

Similar Threads