any chance there will be lifecycle rules like "delete after 1 year of the object not being requested

any chance there will be lifecycle rules like "delete after 1 year of the object not being requested"?

Ssathoro any chance there will be lifecycle rules like "delete after 1 year of the object...

Sam•10/25/23, 7:39 AM

I personally doubt it, but you could create the same effect using KV (or D1) and Workers (and Workers cron triggers, to run a daily check)

Should also keep in mind any local browser and/or cdn caching

SSam I personally doubt it, but you could create the same effect using KV (or D1) and...

sathoroOP•10/25/23, 7:44 AM

yeah probably unlikely. btw a DO alarm should be easiest. can just set it to 1 year every time it's requested (we already route through Workers)

Ssathoro yeah probably unlikely. btw a DO alarm should be easiest. can just set it to 1 y...

Sam•10/25/23, 7:47 AM

Ah never used DO, thanks. Will check out what it has to offer

SSam Ah never used DO, thanks. Will check out what it has to offer 🙂

sathoroOP•10/25/23, 7:48 AM

it's incredible

kian•10/25/23, 7:49 AM

I can see how there'd be a few considerations - i.e if you add a

LastAccessed

LastAccessed

time to objects then are there any clients which will throw due to an unexpected key in the schema? But, like most R2 extensions to S3, they could just throw it in a custom header (or re-use

Last-Modified

Last-Modified

kian•10/25/23, 7:49 AM

It'd be cool to have

KKarew You can create an R2 token that only has read/write access to specific buckets

Айрат Х.•10/25/23, 8:14 AM

I created a token, but I don’t see in the documentation how to make an API request to download a file
I only found this https://developers.cloudflare.com/api/operations/r2-list-buckets

Cloudflare API Documentation

Interact with Cloudflare's products and services via the Cloudflare API

Austin B•10/25/23, 2:01 PM

Does Super Slurper have a public API to initiate migrations programmatically?

If there is a better place to ask this Q, let me know

kev-ac•10/25/23, 7:00 PM

I've added a new zone and a custom domain on a R2 bucket during the "outage" today as these API endpoints seemed to be fine. My problem is that the connection of the bucket to the zone failed and now I'm unable to do anything. No matter if I click "Retry connection" or "Remove domain" I get a

The specified bucket does not exist. (Code: 10006)

The specified bucket does not exist. (Code: 10006)

error. I can create another custom domain on the bucket and it works fine.

kev-ac•10/25/23, 7:01 PM

Is there someone from CF I can give my account ID and bucket name to to have a quick look at it?

AAustin B Does Super Slurper have a public API to initiate migrations programmatically? I...

kev-ac•10/25/23, 7:54 PM

I don't think there is an official API endpoint for super slurper, just for sippy.

Bruce Liu•10/26/23, 7:32 AM

I am using cloudflare R2 to upload a video and then play the video, and there are many problems that are difficult for me to understand. Can anyone help me? This is a picture that may appear. When I click on the video progress bar, it turns out that A 200 status code appeared, and then it started trying to download the entire video, OMG!!! I was using a domain I hosted on cloudflare. When I paused the domain on my cloudflare, it went back to normal. .Can anyone help me?

Bruce Liu•10/26/23, 7:46 AM

Has anyone encountered this kind of problem? It’s really difficult.

Erisa•10/26/23, 8:29 AM

What method are you serving the R2 bucket through? A Worker or a custom domain?

EErisa What method are you serving the R2 bucket through? A Worker or a custom domain?

Bruce Liu•10/26/23, 9:21 AM

I usea a Custom Domain.
When I used the Public R2.dev Bucket URL, this problem did not occur.

Bruce Liu•10/26/23, 9:24 AM

Of course, if the developer mode is turned on, this problem will not occur. I am really confused. I have turned off all the cloudflare options under my domain name. But it still doesn’t work. I can only choose developer mode, this situation will not occur.

BBruce Liu I usea a Custom Domain. When I used the Public R2.dev Bucket URL, this problem ...

Erisa•10/26/23, 9:39 AM

Looks like its the known issue with files that are too large to fit into cache, the workaround is to bypass cache for these files using Cache Rules

EErisa Looks like its the known issue with files that are too large to fit into cache, ...

Bruce Liu•10/26/23, 9:48 AM

OK, the video file is 5GB in size. However, I'm going to try writing rules now, bypass caching, and try.

Bruce Liu•10/26/23, 9:59 AM

I bypassed all caches through PAGE RULES, but unfortunately, it didn't take effect~

Bruce Liu•10/26/23, 10:04 AM

The cache rules are set like this, I don’t know if it takes effect. But the problem still exists, and the request status code of 200 still appears.

BBruce Liu The cache rules are set like this, I don’t know if it takes effect. But the prob...

Karew•10/26/23, 10:22 AM

Did you clear your existing cache? Also you can try the new Trace tool to check if rules are being applied to a request https://blog.cloudflare.com/traffic-transparency-unleashing-cloudflare-trace/

Bruce Liu•10/26/23, 10:47 AM

https://kangeshu.xyz/loki.mp4 This is my video link. When I slide the progress bar, I can still see the 200 request status code. I am going crazy.

BBruce Liu The cache rules are set like this, I don’t know if it takes effect. But the prob...

Erisa•10/26/23, 11:06 AM

Cache rules dont support wildcard, use "contains" as the operator and

as the value

Hello, I’m Allie!•10/26/23, 11:27 AM

Given that I upload a PNG to this Worker, is there any reason why it would return corrupted?

export default <ExportedHandler<Environment>>{
    async fetch(req, env) {
        if (req.method === "POST") {
            return Response.json(await env.R2.put("file", req.body));
        }
        return new Response((await env.R2.get("file"))?.body, {
            headers: {
                "content-type": "image/png"
            }
        });
    }
}

export default <ExportedHandler<Environment>>{
    async fetch(req, env) {
        if (req.method === "POST") {
            return Response.json(await env.R2.put("file", req.body));
        }
        return new Response((await env.R2.get("file"))?.body, {
            headers: {
                "content-type": "image/png"
            }
        });
    }
}

EErisa Cache rules dont support wildcard, use "contains" as the operator and `/` as the...

Bruce Liu•10/26/23, 11:36 AM

Thank you! I solved this problem.

Original message was deleted

Hello, I’m Allie!•10/26/23, 11:39 AM

The image returned doesn't have a matching SHA-Sum, for one:

3be0c615e0158c0ba0110ba40f2de4db36e24c32  original.png
ca96b61d7c28300963e091080819f46221f34d4a  downloaded.png

3be0c615e0158c0ba0110ba40f2de4db36e24c32  original.png
ca96b61d7c28300963e091080819f46221f34d4a  downloaded.png

The other is that it can't be opened at all

Hello, I’m Allie!•10/26/23, 11:46 AM

Yeah, that was it...

Hello, I’m Allie!•10/26/23, 11:46 AM

Thanks!

Bruce Liu•10/26/23, 11:47 AM

My front-end uses S3 SDK JS to upload files to R2. But now I need to use a pre-signed URL to upload files. Am I unable to use the S3 client? Can I only use XHR or FETCH directly?

Bruce Liu•10/26/23, 11:49 AM

Because in the S3 SDK, there are multiple uploads, disconnection reconnection and other mechanisms. These are all functions that I really need, because I upload some video files, which are relatively large. But if I use S3 to upload directly, I have to Expose my KEY on the browser side. My project uses JAVA+SPRINGBOOT.

dave.swift•10/26/23, 12:57 PM

I am trying to stream content to R2

put

put

API. However, I keep getting "Provided readable stream must have a known length (request/response body or readable half of FixedLengthStream)" error. I have detailed a basic code example at https://gist.github.com/e332890143f40d1803a8d2aed089c517. Has anyone run into this and/or have a solution. Much appreciated!

kian•10/26/23, 1:00 PM

You would need to buffer the compressed stream in memory so that the size is known

dave.swift•10/26/23, 1:01 PM

Unfortunately, it's too large to fit in memory.

kian•10/26/23, 1:01 PM

That’s the only option for Workers - R2 requires the size to be known

dave.swift•10/26/23, 1:03 PM

That's disappointing. I thought that was the main purpose of using streams was to not load it all in memory at once. I appreciate your help though.

dave.swift•10/26/23, 2:02 PM

For what it's worth, I think I found a viable workaround (though not ideal obviously). I am breifly storing the compressed file in cache, then streaming it to R2. (example: https://gist.github.com/e332890143f40d1803a8d2aed089c517)

Sinan Kochan•10/26/23, 3:08 PM

Hello, i am using my R2 bucket for a short time, even though my bucket is public i cannot reach assets in it. i get "ERR_SSL_PROTOCOL_ERROR" What can i do for it?

Ddave.swift For what it's worth, I think I found a viable workaround (though not ideal obvio...

Sid•10/26/23, 4:28 PM

Have you also considered using multipart uploads for this? Thinking out loud, you could buffer a few chunks in the Worker’s memory and batch them in an UploadPart request, then complete the upload when the stream ends (or abort it if the stream errors)

stillmotion•10/26/23, 8:22 PM

Anyone experienced agreessive image caching on Chrome that causes CORS errors? I changed my allowed origins in R2 to

to avoid them, but still seeing it intermittently. Only solution I've found so far is to "Disable cache" in the dev tools network tab, and that only works some of the time.

vuliad•10/26/23, 8:40 PM

Hi! We have some problems with R2 right now. From some origins R2 just timeouts.

vuliad•10/26/23, 8:40 PM

vuliad•10/26/23, 8:41 PM

Does anyone having same problems?

alexandernst•10/26/23, 9:10 PM

I need to upload a huge amount of (small) files to R2 (we're talking about several million). And I need to keep uploading newly generated files, while skipping the ones that were already uploaded.

What would it be a good way to achieve that?

if I understand the docs correctly, rclone can check if each file exists (with an API call) and upload it (with another API call), but this is basically the same as just uploading it directly (the files are just a couple of kb so the round trip for an extra API call is more expensive than just uploading the file). And that wastes a lot of time and resources. Not ideal.

Maybe R2 supports uploading a zip and unzipping it once uploaded?

Aalexandernst I need to upload a huge amount of (small) files to R2 (we're talking about sever...

Hello, I’m Allie!•10/26/23, 9:24 PM

Those two API calls ensure that you aren’t uploading a file that already exists

Hello, I’m Allie!•10/26/23, 9:24 PM

So if you want to pay Class A Ops for every file, you can probably make it do that

alexandernst•10/26/23, 9:25 PM

so this is basically a tradeoff between speed (less speed because of 1 extra API call), and cost (it will be cheaper because of Class A ops)

alexandernst•10/26/23, 9:26 PM

what about uploading a zip file and unzipping it in r2? Is that possible?

kian•10/26/23, 9:31 PM

Nope

export default <ExportedHandler<Environment>>{ async fetch(req, env) { if (req.method === "POST") { return Response.json(await env.R2.put("file", req.body)); } return new Response((await env.R2.get("file"))?.body, { headers: { "content-type": "image/png" } }); } }

any chance there will be lifecycle rules like "delete after 1 year of the object not being requested

Similar Threads