yeah just to be clear, do you mean having the worker proxy the actual data, or just redirect with th

yeah just to be clear, do you mean having the worker proxy the actual data, or just redirect with the presigned url

kraftriver•7/3/23, 8:15 PM

what i want is proxy the presigned url from cloudflare so people don't see the cloudflare domain but my domain like this storage.mydomain.com/token

PhatsoOP•7/3/23, 8:16 PM

when you say "see", is this in a web browser ?

PPhatso yeah just to be clear, do you mean having the worker proxy the actual data, or j...

Unsmart•7/3/23, 8:16 PM

You wouldnt need to redirect workers doesnt bill for the time it takes to transfer it stops once you start sending back data

kraftriver•7/3/23, 8:16 PM

by using a worker function with my subdomain it would work but then the function will run for as long as the download will be running

PPhatso when you say "see", is this in a web browser ?

kraftriver•7/3/23, 8:16 PM

yes in the browser

PhatsoOP•7/3/23, 8:16 PM

i think unsmart is saying that the cost for that download duration would be negligible, even at the scales you were talking about

PhatsoOP•7/3/23, 8:17 PM

don't want to speak for them though, i think we weren't all on the same page

Unsmart•7/3/23, 8:17 PM

You could also just use bundled workers which dont have any charge for duration if you are scared of duration billing

PhatsoOP•7/3/23, 8:17 PM

that could be a good option too

kraftriver•7/3/23, 8:17 PM

i don't think it would be negligable at all. So let's take 10 million image a day at 1MB through a worker function

kraftriver•7/3/23, 8:18 PM

well, bundled do have a 50ms cost duration as well

PhatsoOP•7/3/23, 8:18 PM

true

kraftriver•7/3/23, 8:18 PM

so if the time to download is like 500ms it would be 10 cycle

PhatsoOP•7/3/23, 8:19 PM

but the gb/s would still be high for 10M images a day at 1mb a piece

PhatsoOP•7/3/23, 8:19 PM

right?

Kkraftriver so if the time to download is like 500ms it would be 10 cycle

Unsmart•7/3/23, 8:19 PM

a fetch request takes 0ms

PhatsoOP•7/3/23, 8:20 PM

it might be useful to do a quick napkin-math calculation for his specific example

Unsmart•7/3/23, 8:20 PM

wall time and cpu time are very different

kraftriver•7/3/23, 8:21 PM

In bundled it would cost 50$ per 10M images which download over 500ms in average. If my calculation are correct

PhatsoOP•7/3/23, 8:21 PM

just to be sure here james, they said that as soon as your worker starts responding to the request, the timer stops

PhatsoOP•7/3/23, 8:21 PM

so the time for the file to actually get to the client is not included in that duration cost

PPhatso just to be sure here james, they said that as soon as your worker _starts_ respo...

kraftriver•7/3/23, 8:21 PM

i don't think it's how worker work

PhatsoOP•7/3/23, 8:22 PM

if i understand them correctly, i think both leo and unsmart confirmed that is how they work

UUnsmart You wouldnt need to redirect workers doesnt bill for the time it takes to transf...

PhatsoOP•7/3/23, 8:22 PM

this one here

PhatsoOP•7/3/23, 8:23 PM

quick question: could you maybe make it a public bucket, hook it up to a custom domain and then access the files that way? I thought that was a solution for this kind of thing.

ref: https://developers.cloudflare.com/r2/buckets/public-buckets/#custom-domains-configuration

PPhatso quick question: could you maybe make it a public bucket, hook it up to a custom ...

Unsmart•7/3/23, 8:23 PM

If your files are public yes

PhatsoOP•7/3/23, 8:23 PM

does a presigned url imply that they aren't public

Unsmart•7/3/23, 8:23 PM

yes

PhatsoOP•7/3/23, 8:24 PM

i see

Unsmart•7/3/23, 8:24 PM

I mean you could make presignedurls public but a presigned url requires generation from a secret key

PhatsoOP•7/3/23, 8:24 PM

right, that makes sense

kraftriver•7/3/23, 8:25 PM

well i don't get it then. to download something from a server / serverless function. Something need to be running isn't it? if the fetch request take 0ms, what about the response time to the user? it's not counted in the workers duration cost ?

PhatsoOP•7/3/23, 8:25 PM

nope, it's not

PhatsoOP•7/3/23, 8:25 PM

so @james8313 i believe this means that you'd only be billed for the time it takes the worker to retrieve the data from r2. once it starts responding with the data, the timer stops and you won't be billed for worker time anymore for that request

kraftriver•7/3/23, 8:26 PM

Okay, well, i'll try and see then.

PhatsoOP•7/3/23, 8:26 PM

r2 returns a readable stream, can you return that readable stream without the worker having to actually retrieve all of the data into memory

PhatsoOP•7/3/23, 8:27 PM

nice so that's nearly instant then

PhatsoOP•7/3/23, 8:27 PM

okay so not only is it a good way to do it, it's the way to do it

PhatsoOP•7/3/23, 8:28 PM

is this what the mandalorian guy was talking about

PhatsoOP•7/3/23, 8:28 PM

cloudflare r2 retrieval strategies

kraftriver•7/3/23, 8:28 PM

and it's the same for 1GB file or whatever size of file it is ? It seems so hard to get my head around it

PhatsoOP•7/3/23, 8:28 PM

cloudflare pricing is insanely generous, it lets people make extremely powerful apps without breaking the bank. it's amazing

Kkraftriver and it's the same for 1GB file or whatever size of file it is ? It seems so hard...

Walshy•7/3/23, 8:29 PM

Yep

Walshy•7/3/23, 8:29 PM

Want to stream a TB file or a 1 MB file? Still the same

PhatsoOP•7/3/23, 8:29 PM

i guess one way to think about it is that once the worker starts returning the data, the actual worker code isn't running anymore, it's just a data stream

PhatsoOP•7/3/23, 8:29 PM

like your js code has effectively stopped running

Walshy•7/3/23, 8:29 PM

Snippets

kraftriver•7/3/23, 8:29 PM

"and a isolate could serve multiple requests at once" really ? i always thought they could serve only 1 request at once and create more instance for every new concurrent request happening at the same time

kraftriver•7/3/23, 8:33 PM

kraftriver•7/3/23, 8:36 PM

Snippet is so awesome can't wait to use it

yeah just to be clear, do you mean having the worker proxy the actual data, or just redirect with th

Similar Threads