Cloudflare Developers•14mo ago

r2 cached, timing in worker

CChaika r2 cached, timing in worker

elpupper•10/31/24, 4:11 PM

how big is your data?

elpupper•10/31/24, 4:11 PM

the file you requested

ChaikaOP•10/31/24, 4:11 PM

10kb

elpupper•10/31/24, 4:11 PM

:pepethink:

ChaikaOP•10/31/24, 4:11 PM

I don't think size is too much of a factor though, once you get it streaming -- it well streams back at pretty decent speeds

ChaikaOP•10/31/24, 4:12 PM

r2 uncached from enam region to enam bucket

ChaikaOP•10/31/24, 4:13 PM

KV's pretty solid

SSpunkie routes don't cause a cname to be applied, only custom domains ya?

Spunkie•10/31/24, 4:13 PM

@Chaika sorry I confused myself but to be clear, a CNAME that is proxied and flattened can or can not be intercepted by a worker with a route setup to catch something on that cname/subdomain?

SSpunkie @Chaika sorry I confused myself but to be clear, a CNAME that is proxied and fla...

ChaikaOP•10/31/24, 4:13 PM

flattening shouldn't matter at all, not even sure why it shows up on proxied records currently

ChaikaOP•10/31/24, 4:14 PM

Proxy inherently needs to unflatten it to connect, as the client sure can't

SSpunkie @Chaika sorry I confused myself but to be clear, a CNAME that is proxied and fla...

ChaikaOP•10/31/24, 4:14 PM

So the answer is yes* as long as you're not CNAMEing to a CF for SaaS partner on the legacy integration like Shopify

CChaika KV's pretty solid

elpupper•10/31/24, 4:14 PM

beautiful

elpupper•10/31/24, 4:15 PM

might have to resort to KV

CChaika What you store in memory/global? no File system? They don't have any

elpupper•10/31/24, 4:17 PM

how long is it presistent for in memory

Eelpupper how long is it presistent for in memory

ChaikaOP•10/31/24, 4:18 PM

as long as it's getting frequent requests but it's complex in reality

ChaikaOP•10/31/24, 4:19 PM

Workers run on the same edge machine which handled your original request. There is no affinity to routing to a specific machine which already has your worker running. There is keepalive. Chance of two random connections hitting the same machine and thus getting the same worker is pretty low, espec when it can be any machine at any cf pop. However, keepalive can make it confusing since your browser would keep hitting the same

ChaikaOP•10/31/24, 4:19 PM

If you're worried about cold starts, CF does a good job of that, taking advantage of the tls handshake to warm up the worker during initial connection, elimating cold starts unless you've got a big worker/a lot of code in global scope

ChaikaOP•10/31/24, 4:20 PM

but def don't rely on global scope for anything

CChaika If you're worried about cold starts, CF does a good job of that, taking advantag...

elpupper•10/31/24, 4:20 PM

its not about coldstarts

elpupper•10/31/24, 4:20 PM

its more about i have templates that i need to serve

elpupper•10/31/24, 4:20 PM

static html, css

CChaika r2 uncached from enam region to enam bucket

ItsWendell•10/31/24, 4:27 PM

Where did you get these stats from?

IItsWendell Where did you get these stats from?

elpupper•10/31/24, 4:28 PM

its his own

CChaika err actually I think I have that data lol

elpupper•10/31/24, 4:28 PM

ChaikaOP•10/31/24, 4:33 PM

If you're using KV and you want to measure it's real easy and nothing fancy, just performance.now() and writing to Cloudflare's Analytics Engine, ex:

        var startReq = performance.now();
        await env.KV.put(key, req.body, { // or get
    
        });
        var getDur = performance.now() - startReq;
        if (env.AE)
          env.AE.writeDataPoint({
              blobs: [],
              doubles: [getDur],
              indexes: [key]
            });
...

        var startReq = performance.now();
        await env.KV.put(key, req.body, { // or get
    
        });
        var getDur = performance.now() - startReq;
        if (env.AE)
          env.AE.writeDataPoint({
              blobs: [],
              doubles: [getDur],
              indexes: [key]
            });
...

Then you can use Grafana w/ AE and build nice dashboards relatively easily

CChaika If you're using KV and you want to measure it's real easy and nothing fancy, jus...

elpupper•10/31/24, 6:15 PM

quick question since you seem like you know the ins and outs. How would you go about serving static content? with wildcard domains

would you just store everything in a r2 bucket, then have a worker in the front responding with the proper files?

Eelpupper quick question since you seem like you know the ins and outs. How would you go a...

ChaikaOP•10/31/24, 6:16 PM

wildcard domains being one of your domains, all subdomains, or as in you'd want to hook up customer domains?

CChaika wildcard domains being one of your domains, all subdomains, or as in you'd want ...

elpupper•10/31/24, 6:18 PM

both

elpupper•10/31/24, 6:19 PM

I thought i might get away with doing cd of CF pages

elpupper•10/31/24, 6:19 PM

But doesnt seem like i can

ChaikaOP•10/31/24, 6:19 PM

with the same set of static assets for all, or would customers have different ones or something?

CChaika with the same set of static assets for all, or would customers have different on...

elpupper•10/31/24, 6:19 PM

Different

ChaikaOP•10/31/24, 6:20 PM

For customer domains you need CF For SaaS on top, and you can't do wildcard with CF For SaaS without Enterprise

ChaikaOP•10/31/24, 6:20 PM

you could go Workers Static Assets, pay nothing for requests like pages, and use wildcard routes for your own domain

ChaikaOP•10/31/24, 6:21 PM

then you can use CF For SaaS easily with plain Workers

ChaikaOP•10/31/24, 6:21 PM

if you need lots of customer assets though, well you can only have 500 workers even on paid, and there's limits on assets/would be messy to intermingle, you'd probably want to just throw their custom stuff into KV

ChaikaOP•10/31/24, 6:22 PM

KV is 25 MiB max though, per key (just like Pages and Workers Assets)

CChaika you could go Workers Static Assets, pay nothing for requests like pages, and use...

elpupper•10/31/24, 6:23 PM

I think this is what i need

CChaika if you need lots of customer assets though, well you can only have 500 workers e...

elpupper•10/31/24, 6:25 PM

What about queues

CChaika if you need lots of customer assets though, well you can only have 500 workers e...

elpupper•10/31/24, 6:26 PM

I will see as the content is statically generated

Eelpupper What about queues

ChaikaOP•10/31/24, 6:26 PM

what about them?

CChaika what about them?

elpupper•10/31/24, 6:27 PM

Cant i offload the workload to them?

elpupper•10/31/24, 6:27 PM

I think 500 workers are more than enough for ~10m requests a day

Eelpupper I think 500 workers are more than enough for ~10m requests a day

ChaikaOP•10/31/24, 6:28 PM

wat

ChaikaOP•10/31/24, 6:28 PM

I was saying 500 workers max as you'd likely want to do a worker per customer, like you would a pages project per customer, if they had all their own assets. But hard with the hard-ish cap on workers

ChaikaOP•10/31/24, 6:29 PM

500 Workers, meaning, only 500 Cloudflare Workers you can create. A Single worker can do a billion requests, not limited in scale, or running location, or anything

CChaika I was saying 500 workers max as you'd likely want to do a worker per customer, l...

elpupper•10/31/24, 6:30 PM

Why would i do that? Seems like a waste of resources

ChaikaOP•10/31/24, 6:31 PM

so they can have their own static assets?

ChaikaOP•10/31/24, 6:31 PM

can't quite throw a ton of customer static assets into a single worker

CChaika so they can have their own static assets?

elpupper•10/31/24, 6:31 PM

But i can just throw it into a r2 bucket

var startReq = performance.now(); await env.KV.put(key, req.body, { // or get }); var getDur = performance.now() - startReq; if (env.AE) env.AE.writeDataPoint({ blobs: [], doubles: [getDur], indexes: [key] }); ...

r2 cached, timing in worker

Similar Threads

Similar Threads

Similar Threads