Oh my lord, does anyone know how to upload large files to cloudflare R2 bucket with help of worker w

Oh my lord, does anyone know how to upload large files to cloudflare R2 bucket with help of worker without exceeding worker memory limit? please help

ⱤⱤØ₥₳₦Oh my lord, does anyone know how to upload large files to cloudflare R2 bucket w...

Erisa•1/12/24, 1:38 PM

https://developers.cloudflare.com/r2/api/workers/workers-multipart-usage/

Use the R2 multipart API from Workers · Cloudflare R2 docs

By following this guide, you will create a Worker through which your applications can perform multipart uploads.
This example worker could serve as a …

EErisa https://developers.cloudflare.com/r2/api/workers/workers-multipart-usage/

Ɽ

ⱤØ₥₳₦OP•1/12/24, 1:40 PM

to begin with, Thank you so much for your time and response

of course, I've visited this page a billion times in last 3 days but still unable to understand how to do it. I successfully did upload small file (that doesn't exceed worker memory limit) with normal bucket.put method but there is no proper example for multipart big files

Erisa•1/12/24, 1:44 PM

I see

EErisa I see

Ɽ

ⱤØ₥₳₦OP•1/12/24, 1:54 PM

Do you have sample code by any chance? or you know about any example on web (I'm asking cause i spent whole day staring at screen to find a solution to my problem)?

kian•1/12/24, 3:16 PM

The linked example is the main example for using multipart uploads from Workers and how to manage that from the client application.

kian•1/12/24, 3:16 PM

I'm not aware of any others

Kkian The linked example is the main example for using multipart uploads from Workers ...

Ɽ

ⱤØ₥₳₦OP•1/12/24, 7:11 PM

That's so dumb i mean they gave title "with worker" then they started talking about python script

Ɽ

ⱤØ₥₳₦OP•1/12/24, 7:12 PM

If some can run python script (the actual script that uploads stuff) then why on earth someone even need worker to make it happen? Then can use rclone directly from their computer

Sunshine State•1/12/24, 8:56 PM

Creating a personal/fun hobby website to learn the whole process from soup to nut… any tips or tricks. Good resources to start with?

Sam•1/12/24, 9:12 PM

Hey all, I'm having a lot of trouble adding a custom hostname, as it seems every time I add the DNS entry, it changes to a different one when refreshing.

SSunshine State Creating a personal/fun hobby website to learn the whole process from soup to nu...

Chaika•1/12/24, 9:22 PM

hmm... what specifically? like getting started with html? https://developer.mozilla.org/en-US/docs/Learn/HTML/Introduction_to_HTML/Getting_started
There's a lot of guides on making your own website/etc.
If you go with a static page, just html/css/js, you can then create a Github Repo and use Cloudflare Pages which can automagically update your website on each commit and has unlimited static asset requests

MDN Web Docs

Getting started with HTML - Learn web development | MDN

You made it to the end of the article! We hope you enjoyed your tour of the basics of HTML.

SSam Hey all, I'm having a lot of trouble adding a custom hostname, as it seems every...

Chaika•1/12/24, 9:22 PM

what changes, exactly?

Chaika•1/12/24, 9:24 PM

If you're talking about the visual display of DNS Records, like how adding a subdomain may appear as subdomain.example.com in adding but just subdomainsubdomain in the list after, that's normal

CChaika 👋 what changes, exactly?

Sam•1/12/24, 9:25 PM

Sorry, I could've been more clear in that message

When I add the certificate validation TXT record, and hit Refresh on the top right there, the page thinks for a second, the name/value block goes away, and when I refresh the page, it shows a brand new value

Erisa•1/12/24, 9:28 PM

Thats intended behaviour for cert validation, when you "refresh" it will restart the validation process from the beginning

Sam•1/12/24, 9:28 PM

Ah, I thought it was for checking if the DNS record had been updated.

Sam•1/12/24, 9:28 PM

Thanks!

Sam•1/12/24, 9:52 PM

Hm, I just added the entry without hitting refresh (left the page and all) -- came back and the value had changed again

Erisa•1/12/24, 10:06 PM

You may be best off setting up Delegated DCV so that this isn't an issue and renewals wont require any action either https://developers.cloudflare.com/ssl/edge-certificates/changing-dcv-method/methods/delegated-dcv/

Delegated DCV — Domain Control Validation — SSL/TLS · Cloudflare SS...

Delegated DCV allows zones with partial DNS setups - meaning authoritative DNS is not provided by Cloudflare - to delegate the DCV process to …

EErisa You may be best off setting up Delegated DCV so that this isn't an issue and ren...

Sam•1/12/24, 10:20 PM

Hmm, does that require a partial DNS/CNAME setup? Open to exploring the business plan (especially if it comes with more support for issues like these), but it seems like an expensive solution for something that seems like a bug

SSam Hmm, does that require a partial DNS/CNAME setup? Open to exploring the business...

Erisa•1/12/24, 10:22 PM

No, it doesn't. It's just a way of doing TXT validation automatically using a CNAME instead of creating TXT records manually

EErisa No, it doesn't. It's just a way of doing TXT validation automatically using a CN...

Sam•1/12/24, 10:23 PM

Oh cool - Thanks! I'll give it a go and report back

CChaika hmm... what specifically? like getting started with html? https://developer.mozi...

Sunshine State•1/12/24, 10:49 PM

More so good resources to first learn how Cloudflare works? Like if I wanted to code some stuff where do I do it at? I feel like it’s a little busy with all the navigational references and things to modify. I just want to create a simple landing page first

docy•1/12/24, 11:41 PM

is there any way to see specific endpoint traffic, like on vercel? im only seeing stats for the whole domain

docy•1/12/24, 11:41 PM

it's a worker btw

Erisa•1/12/24, 11:59 PM

You need a domain on the Pro plan to see detailed traffic analytics

fedeb🇦🇷•1/13/24, 1:04 AM

can I use Cache Rules and Page Rles-Cache Level , for the url and endpoints of my Zero Trust tunnel subdomain?

Kasumi•1/13/24, 2:14 AM

Why can't Cloudflare set the Content-Type for svg images?

Unsmart•1/13/24, 2:23 AM

What do you mean? Youre supposed to set the content-type from your server

Kasumi•1/13/24, 2:24 AM

I set and a default installed webserver also can auto detect it but cloudflare rewrites it everytime to text/html

Kasumi•1/13/24, 2:24 AM

or so

Kasumi•1/13/24, 2:24 AM

And then it cant be shown

Unsmart•1/13/24, 2:25 AM

are you sure cloudflare is rewriting it and not the webserver setting it incorrectly

Kasumi•1/13/24, 2:25 AM

I got it now fially

UUnsmart are you sure cloudflare is rewriting it and not the webserver setting it incorre...

Kasumi•1/13/24, 2:26 AM

idk but somehow it works now

Kasumi•1/13/24, 2:26 AM

But could be still nice that cloudflare detects it and changes it

TIEB62•1/13/24, 4:32 PM

Hi I have a question about subdomains of subdomains with the Free plan, I know that Cloudflare doesn't provide any SSL certificate for them but can I still proxy them (orange cloud) for other Cloudflare features and Cloudflare will forward the webserver's certificate ? or are just subdomains of subdomains completely excluded from all features and so must be grey-clouded ?

Erisa•1/13/24, 4:50 PM

They must be grey-clouded but its because of the certificate. In order for any Cloudflare services on the HTTPS layer to work, we can't pass through the servers certificate, we have to use our own edge certificate that we have control of the private keys for

Erisa•1/13/24, 4:50 PM

By the way its not strictly related to the Free zone plan, its a restriction when you don't purchase Advanced Certificate Manager, which is a $10/mo addon for all plan levels

TIEB62•1/13/24, 4:51 PM

Okay thanks for your quick answer

EErisa They must be grey-clouded but its because of the certificate. In order for any C...

Hello, I’m Allie!•1/13/24, 5:11 PM

Doesn’t it work though with services that issue their own certs, I.e. Pages, even if you don’t have ACM?

HHello, I’m Allie!Doesn’t it work though with services that issue their own certs, I.e. Pages, eve...

Erisa•1/13/24, 5:12 PM

Yes if you use those services

Ɽ

ⱤØ₥₳₦OP•1/13/24, 5:13 PM

I want to download a large file from r2 bucket via cloudflare worker, download starts but unlike google drive export links it doesn't support threading/part downloads in IDM

ⱤⱤØ₥₳₦I want to download a large file from r2 bucket via cloudflare worker, download s...

Erisa•1/13/24, 5:31 PM

You need to implement ranged requests, heres an example worker and library that does https://github.com/kotx/render

EErisa You need to implement ranged requests, heres an example worker and library that ...

Ɽ

ⱤØ₥₳₦OP•1/13/24, 5:55 PM

Each range request will count as read?

Erisa•1/13/24, 5:56 PM

Yes thats how those threaded downloaders work, they split the download across multiple threads, each of which is a separate request

Erisa•1/13/24, 5:56 PM

Ranged requests are an important part of this because how it works is each thread downloads a different piece of the file

Erisa•1/13/24, 5:57 PM

e.g. 10 threads = 10 requests, each asking for a different 10% of the file

EErisa e.g. 10 threads = 10 requests, each asking for a different 10% of the file

Ɽ

ⱤØ₥₳₦OP•1/13/24, 5:57 PM

Gotcha, thanks for answering

Erisa•1/13/24, 5:57 PM

No problem

Oh my lord, does anyone know how to upload large files to cloudflare R2 bucket with help of worker w

Similar Threads

Similar Threads

Similar Threads