There is https://developers.cloudflare.com/workers/platform/storage-options/

Julian•1/21/24, 2:22 AM

Hello! I am trying to change the Content-Length header, as I will use Cloudflare Workers to download files from a R2 bucket. I tried by changing the header manually, but it doesnt make a change. Then I read that it was not possible to change that header, and that the only way to do so is by using Streams.

Now, my question is how should I do that? I tried to do it (see the code below), however it does not work. Any advice is very much appreciated!

firmwareBin = await env.R2.get(decodeURI(key));
let { readable, writable } = new FixedLengthStream(175104);
firmwareBin.body.pipeTo(writable);
return new Response(readable, firmwareBin);

firmwareBin = await env.R2.get(decodeURI(key));
let { readable, writable } = new FixedLengthStream(175104);
firmwareBin.body.pipeTo(writable);
return new Response(readable, firmwareBin);

CCyb3r-Jak3 There is https://developers.cloudflare.com/workers/platform/storage-options/

quisi.do•1/21/24, 8:41 AM

This is the doc that I specifically didn't find useful. The DO section didn't really tell me when I'd use it over R2. I feel like you need to already know what the company had in mind for DO before you use it. Like maybe it's some kind of popular storage design that I'm not familiar with, so I don't know what it's for.

divby0•1/21/24, 10:43 AM

I am using a worker for server-sent events. Basicall it reads from a database every 3 seconds and sends the results via SSE to the client. Now if I understand correclty, the new standard pricing will neither evict quickly (like the old bundled plan) nor will it be high duration costs (because only cpu time is important) right?

Qquisi.do This is the doc that I specifically didn't find useful. The DO section didn't re...

Cyb3r-Jak3OP•1/21/24, 2:32 PM

R2 is better for bigger files as it has the largest storage size. DO is good when you need all the data to be synced across the global.

Ddivby0 I am using a worker for server-sent events. Basicall it reads from a database ev...

Acе•1/21/24, 3:01 PM

Eviction can happen on any plan but usually doesn’t happen unless there’s a Cloudflare update (about once a day in my experience), free plan users get evicted more frequently than paid/Enterprise. And yes it’s charged in CPU milliseconds instead of wall time.

AAcе Eviction can happen on any plan but usually doesn’t happen unless there’s a Clou...

divby0•1/21/24, 3:15 PM

Thank you

.gwapes•1/21/24, 8:17 PM

For a worker route, if you don’t setup any rate limiting

.gwapes•1/21/24, 8:17 PM

What’s like the, default rate limit set to

kian•1/21/24, 8:18 PM

Free is 1000 reqs per min

kian•1/21/24, 8:18 PM

Paid doesn't have one (that limits the whole Worker)

CCyb3r-Jak3 R2 is better for bigger files as it has the largest storage size. DO is good whe...

quisi.do•1/21/24, 8:44 PM

Those don't seem related though.

What if I need small files (~2kB) that serve more as debug logs and will rarely-to-never be accessed?

Qquisi.do Those don't seem related though. 😂 What if I need small files (~2kB) that serv...

Hello, I’m Allie!•1/21/24, 8:46 PM

I would still go for R2. DOs are more for when you need compute attached to storage

kian•1/21/24, 8:47 PM

Durable Objects are stateful Workers that have transactional storage attached

kian•1/21/24, 8:47 PM

R2 is just object storage, strongly consistent with an S3 API

kian•1/21/24, 8:47 PM

By far the simplest to use, since the S3 API means you can interact with it outside of Workers/the CF REST API

quisi.do•1/21/24, 9:05 PM

I'm only using Workers to write the data, but I don't intend to read much from it.

quisi.do•1/21/24, 9:05 PM

But "compatible with S3" doesn't really mean much if I'm not using S3.

kian•1/21/24, 9:06 PM

Means you can back it up easily, interact with it outside of Workers (i.e your own device), migrate to other storage options easily, etc

kian•1/21/24, 9:07 PM

It's not about you using S3, it's about how many things integrate or work with the S3 API

Kkian Durable Objects are stateful Workers that have transactional storage attached

quisi.do•1/21/24, 9:09 PM

Don't both R2 and DO advertise as strongly consistent? If that's not a tie-breaker between them, what is?

kian•1/21/24, 9:10 PM

https://developers.cloudflare.com/r2/reference/limits/ vs https://developers.cloudflare.com/durable-objects/platform/limits/

Kkian It's not about you using S3, it's about how many things integrate or work with t...

quisi.do•1/21/24, 9:10 PM

I'm not currently using, nor going to use, anything that integrates with the S3 API, so this doesn't help me choose between them.

quisi.do•1/21/24, 9:12 PM

The limit page is a bit better than the differences page.

Looks like R2 is for just dumping data into it [free tier + unlimited storage]. DO says it's a paid-only feature that limits you to 50GB for your entire account.

Unsmart•1/21/24, 9:16 PM

50GB is the initial account limit easy to raise

Qquisi.do Those don't seem related though. 😂 What if I need small files (~2kB) that serv...

dave•1/21/24, 9:16 PM

I would go with Wasabi or Backblaze.

Kkian Free is 1000 reqs per min

.gwapes•1/21/24, 9:33 PM

ok thanks

Julian•1/21/24, 10:27 PM

Workers doesnt allow to change the content-length header or what?

kian•1/21/24, 10:29 PM

Why would you want a custom Content-Length header? meowthinking

Julian•1/21/24, 10:30 PM

I wanna use Workers to act as a middleman (for auth) between R2 and the client. The client is a machine that requires the files we store in R2.

Julian•1/21/24, 10:31 PM

I wanna send those files once the client gets authenticated. However the client wont download the file if the content-length header is not correct

Julian•1/21/24, 10:32 PM

Try this: https://updates-dev.autoplants.workers.dev/AP-CRW-20/firmware.bin

Julian•1/21/24, 10:32 PM

if you curl it, you can see the content-length is 15

Julian•1/21/24, 10:32 PM

However, it should be 175104

Cyb3r-Jak3OP•1/21/24, 10:33 PM

I'm seeing the file contains

[object Object]

[object Object]

are you sure the file was uploaded to R2 correctly?

kian•1/21/24, 10:33 PM

Yeah, that wasn't uploaded right

CCyb3r-Jak3 I'm seeing the file contains `[object Object]` are you sure the file was uploade...

Julian•1/21/24, 10:34 PM

Yeah

CCyb3r-Jak3 I'm seeing the file contains `[object Object]` are you sure the file was uploade...

Julian•1/21/24, 10:34 PM

Thats just the body

Julian•1/21/24, 10:34 PM

Try it in a browser

Cyb3r-Jak3OP•1/21/24, 10:34 PM

That's how I got it

kian•1/21/24, 10:34 PM

Browser or not doesn't change what the body is.

Julian•1/21/24, 10:35 PM

I can download it without any problem from the browser. It doesnt show [object Object]

Cyb3r-Jak3OP•1/21/24, 10:35 PM

Try opening the file

Julian•1/21/24, 10:35 PM

CCyb3r-Jak3 Try opening the file

Julian•1/21/24, 10:36 PM

Its a binary, why do you wanna open it?

kian•1/21/24, 10:36 PM

Because it isn't.

kian•1/21/24, 10:36 PM

It's text, that says

[object Object]

[object Object]

kian•1/21/24, 10:36 PM

It wasn't uploaded properly, the binary isn't there

Julian•1/21/24, 10:36 PM

Yeah

Julian•1/21/24, 10:37 PM

it was just me trying something

Cyb3r-Jak3OP•1/21/24, 10:37 PM

Go to the R2 dashboard and download the file from there. Is it a binary file?

There is https://developers.cloudflare.com/workers/platform/storage-options/

Similar Threads