Guys, what is the expected time to get a response from workers? I am seeing a weird timing issue.

Guys, what is the expected time to get a response from workers?

I am seeing a weird timing issue.

I have created an API route that return {}. empty object.

When I request it from my location (Europe to NVirginia) I get the response within 180ms.
When a worker requests that data, the worker takes 400 to 490ms to return what took me 180ms. (It uses COLO - FRA)

Anyidea why there's such a big overhead when it comes to it? How can I debug all those times to make sure?

Hhash My plan was to store each index in a dedicated worker. If my understanding is co...

Chaika•1/31/24, 4:18 PM

If you mean hardcoding the "index" (an array of objects, you said?) in the worker code, if its quick enough to load, CF will warm up your worker during the tls connect and in a lot of cases elimate cold starts:
https://blog.cloudflare.com/eliminating-cold-starts-with-cloudflare-workers
If it's anything that can change/calculated off request/cache sort of thing, you'd want Durable Objects most likely

RRapid Guys, what is the expected time to get a response from workers? I am seeing a w...

RapidOP•1/31/24, 4:36 PM

Is there a difference between free version and paid version?

RRapid Guys, what is the expected time to get a response from workers? I am seeing a w...

Chaika•1/31/24, 4:38 PM

If your API Proxied?
In a worker you could time the request

const start = performance.now();
const response = await fetch("https://developers.cloudflare.com/");
const end = performance.now();
const timing = end - start; // duration of the subrequest to developers.cloudflare.com

Could you share the endpoints? Curious if I can repro
Might just be a routing thing

RapidOP•1/31/24, 4:38 PM

Can I DM you for the endpoint?

Chaika•1/31/24, 4:38 PM

Sure

SSDD•1/31/24, 4:38 PM

I noticed that requests are cached with workers by default, how does that work? Is it at the browser level or with cf?

SSSDD I noticed that requests are cached with workers by default, how does that work? ...

SSDD•1/31/24, 4:39 PM

can I get some links

Hhash If my understanding is correct, There is persistence between requests if loading...

Chaika•1/31/24, 4:40 PM

There's always persistence between requests to the same isolate. The thing is each metal/machine has its own isolates, each colo/cf dc has its own metals, some Pops have mutiple colos, and besides your own connection persistence there's no routing preference to go to a machine that already has your isolate spun up on it

SSSDD can I get some links

SSDD•1/31/24, 4:40 PM

is it https://developers.cloudflare.com/cache/concepts/default-cache-behavior/?

Default Cache Behavior · Cloudflare Cache (CDN) docs

Cloudflare respects the origin web server’s cache headers in the following order unless an Edge Cache TTL cache rule overrides the headers.

CChaika Sure

RapidOP•1/31/24, 4:41 PM

Sent all necessary data in DM

Hhash So in this particular case, The isolate fetches the array of objects, stores it...

Hello, I’m Allie!•1/31/24, 4:57 PM

Though note that your Worker cannot do IO in startup mode

Hello, I’m Allie!•1/31/24, 4:57 PM

So you can't fetch stuff or interact with Bindings

HHello, I’m Allie!Though note that your Worker cannot do IO in startup mode

SSDD•1/31/24, 5:46 PM

I don't know about other langs, but I found very interesting way around (for rust)..

if we have files predefined, then we can load the content at compile time

example:

macro_rules! load_file {
    ($name:literal) => {
        include_str!(concat!(
            env!("CARGO_MANIFEST_DIR"),
            "/some/path",
            $name
        ))
    };
}

macro_rules! load_file {
    ($name:literal) => {
        include_str!(concat!(
            env!("CARGO_MANIFEST_DIR"),
            "/some/path",
            $name
        ))
    };
}

this will read the file content and we store it in memory

SSSDD can I get some links

SSDD•1/31/24, 5:46 PM

can someone help with this please

SSSDD I don't know about other langs, but I found very interesting way around (for rus...

Hello, I’m Allie!•1/31/24, 5:53 PM

Yeah, though too, if you can do that, you should be able to precompute the result too, depending on what you are doing

SSSDD I noticed that requests are cached with workers by default, how does that work? ...

dave•1/31/24, 6:16 PM

you can override it by setting cache rules in the cloudflare dashboard ui for any domain

Ddave you can override it by setting cache rules in the cloudflare dashboard ui for an...

SSDD•1/31/24, 6:25 PM

I am looking for some docs which says how to content is cached

I have a worker deployed, which makes post requests and gets json as response which is cached I think

but I want to know if it's cached in the browser or the local server or is it cached for all workers like kv

SSSDD I am looking for some docs which says how to content is cached I have a worker...

dave•1/31/24, 6:26 PM

which makes post requests and gets json as response

POST requests aren't going to be cached by default.

SSDD•1/31/24, 6:26 PM

SSDD•1/31/24, 6:27 PM

looks like it's cached

SSDD•1/31/24, 6:28 PM

1st response took 2.4 sec then it was ~50ms

dave•1/31/24, 6:29 PM

I can't tell if the your browser is caching or not from that screenshot

dave•1/31/24, 6:29 PM

you can do

wrangler tail

wrangler tail

to see if your worker is being hit or not

SSDD•1/31/24, 6:30 PM

there is no implementation for caching

SSDD•1/31/24, 6:30 PM

running without remote flag takes around the same time for each req

SSDD•1/31/24, 6:30 PM

afaik egress is cached

SSDD•1/31/24, 6:30 PM

but at what level

Isaac McFadyen•1/31/24, 6:34 PM

GraphQL requests are cached by default with some GraphQL servers so if it's caching a GraphQL POST then that's probably why.

Isaac McFadyen•1/31/24, 6:34 PM

(as in, not at the CDN level, it would be at the Worker/GraphQL library level)

SSDD•1/31/24, 6:35 PM

what's worker level? The local server?

SSSDD what's worker level? The local server?

Isaac McFadyen•1/31/24, 6:35 PM

I assume you have a Worker serving GraphQL requests there?

IIsaac McFadyen GraphQL requests are cached by default with some GraphQL servers so if it's cach...

SSDD•1/31/24, 6:36 PM

nope, the back end is our graphql server, it does not have any caching implemented for worker

IIsaac McFadyen I assume you have a Worker serving GraphQL requests there?

SSDD•1/31/24, 6:36 PM

yes

SSSDD yes

Isaac McFadyen•1/31/24, 6:36 PM

What GraphQL server is it?

Isaac McFadyen•1/31/24, 6:36 PM

For example, Apollo server sometimes has caching enabled by default.

Isaac McFadyen•1/31/24, 6:37 PM

It's definitely not the CDN caching it unless you have specifically told the CDN to cache it somehow.

SSDD•1/31/24, 6:37 PM

we are making some thing like apollo server

SSDD•1/31/24, 6:37 PM

https://github.com/tailcallhq/tailcall/

Isaac McFadyen•1/31/24, 6:38 PM

It looks like you have a cache of some sort there?

Isaac McFadyen•1/31/24, 6:39 PM

https://github.com/tailcallhq/tailcall/blob/main/src/http/cache.rs

SSDD•1/31/24, 6:39 PM

yes that's different thing

SSDD•1/31/24, 6:39 PM

it's entity cache

SSDD•1/31/24, 6:39 PM

you can use @cache@cache operator in the schema, which caches specific parts of the schema

SSDD•1/31/24, 6:39 PM

with specified ttl

IIsaac McFadyen <https://github.com/tailcallhq/tailcall/blob/main/src/http/cache.rs>

SSDD•1/31/24, 6:45 PM

I thought you were referring to https://github.com/tailcallhq/tailcall/blob/main/cloudflare/src/cache.rs

but anyways even that code is not used, it was recently introduced, the screenshot is quite old

GaryDix•1/31/24, 11:43 PM

The comments i get are for another worker that is running, the one under fev is silent/

Guys, what is the expected time to get a response from workers? I am seeing a weird timing issue.

Similar Threads

Similar Threads

Similar Threads