Per request. Workers scale(basically) infinitely across multiple devices/requests, but requests from

Per request. Workers scale(basically) infinitely across multiple devices/requests, but requests from the same device/client may share a single isolate

HHard@Work Per request. Workers scale(basically) infinitely across multiple devices/request...

Zack•8/14/24, 4:02 PM

I see, that could explain the issues we're seeing then. Why may they share the same isolate when from the same device/client?

Zack•8/14/24, 4:03 PM

Debugging this is proving a huge pain, especially as I can't get performance metrics for the CPU based part of the functions

ZZack I see, that could explain the issues we're seeing then. Why may they share the s...

Hard@WorkOP•8/14/24, 4:05 PM

Connection Affinity. Basically, when you make multiple requests to a Cloudflare-protected website, your browser(or other client) may store information about the connection(which server you are connected to), so that you continue to connect to the same server over multiple requests. If you make multiple requests to the same machine for a Worker then they share an isolate(unless it is overloaded, iirc)

Hard@WorkOP•8/14/24, 4:07 PM

Sorry if this sounds confusing, I'm not sure I've worded it as clearly as can be

HHard@Work Connection Affinity. Basically, when you make multiple requests to a Cloudflare-...

Zack•8/14/24, 4:07 PM

I see. Have you got any suggestions on how to understand what's causing the performance problems we're seeing? I'm basically stuck between a rock and a hard place right now. Our currently implementation uses too much memory, but the new implementation causes this strange behaviour

ZZack I see. Have you got any suggestions on how to understand what's causing the perf...

Hard@WorkOP•8/14/24, 4:08 PM

DevTools might be of use here? https://developers.cloudflare.com/workers/testing/debugging-tools/#chrome-devtools

Cloudflare Docs

Debugging tools | Cloudflare Workers docs

Debug your local and deployed Workers using a variety of tools.

Zack•8/14/24, 4:08 PM

We basically store 3MB "lookup tables" in KV, previously we pulled these into memory, but with high concurrent request count that causes out of memory issues. So we are trying to stream the lookup table and process them per entry so we only use 64KiB per request (for the buffer)

Zack•8/14/24, 4:08 PM

But while doing that I am seeing super weird behaviour like the R2 requests taking 10 seconds or even 25 seconds alone sometimes

Zack•8/14/24, 4:09 PM

Which is where my theories about contention came in

Zack•8/14/24, 4:09 PM

I'll try to get that debugging working remotely

HHard@Work DevTools might be of use here? https://developers.cloudflare.com/workers/testing...

Zack•8/14/24, 4:51 PM

Sorry, one more thing, the really odd behaviour is this

Zack•8/14/24, 4:51 PM

The requests all get stuck for a while, and then basically all come back at the same instant

Zack•8/14/24, 4:52 PM

Zack•8/14/24, 4:52 PM

That's the call to R2

Brett Willis•8/14/24, 10:15 PM

ReadableStreamBYOBReader.readAtLeast(minBytes, bufferArrayBufferView)

ReadableStreamBYOBReader.readAtLeast(minBytes, bufferArrayBufferView)

as per
https://developers.cloudflare.com/workers/runtime-apis/streams/readablestreambyobreader/#methods says:

Returns a promise with the next available chunk of data read into a passed-in buffer. The promise will not resolve until at least minBytes have been read.

What happens if the source stream ends with less than

minBytes

minBytes

available? A little bit of sanity would say that it would resolve with the buffer partially filled with the available bytes, rather than rejecting, but that contradicts the absolute statement "The promise will not resolve until at least minBytes have been read". Can someone confirm and perhaps update the docs?

Yakuzo•8/15/24, 10:24 AM

Hello, I have a question about Workers pricing. There is a line written in the pricing for inter-worker sub-requests that they are not charged.

 Inbound requests to your Worker. Cloudflare does not bill for subrequests you make from your Worker.

 Inbound requests to your Worker. Cloudflare does not bill for subrequests you make from your Worker.

https://developers.cloudflare.com/workers/platform/pricing/
Just to make sure I understand, this means that if I make a request to a worker from a client and this worker needs to call two other workers in JsRPC, this will count as a single request (but will bill me for the execution time in ms on all the workers), right? Or have I misunderstood?

Cloudflare Docs

Pricing | Cloudflare Workers docs

Workers plans and pricing information.

Alf•8/15/24, 12:32 PM

beg someone helps me setup #How can someone fix this sending subject to discord webhook!

ArmoredCavalry•8/15/24, 12:57 PM

Had a couple questions on the Snippets alpha. Does anyone know if 1) There are plans to add analytics / logging for when a Snippet Worker runs into a resource limit error? 2) Plans to allow for async actions, to execute after the response has been returned (like a full Worker)?

AArmoredCavalry Had a couple questions on the Snippets alpha. Does anyone know if 1) There are p...

Alf•8/15/24, 1:42 PM

ion kno

AArmoredCavalry Had a couple questions on the Snippets alpha. Does anyone know if 1) There are p...

Alf•8/15/24, 1:47 PM

Alf•8/15/24, 1:47 PM

if i can get mine to work

Alf•8/15/24, 1:47 PM

ill do updates for it

Alf•8/15/24, 5:44 PM

someone come help in #How can someone fix this sending subject to discord webhook!

Alf•8/15/24, 8:06 PM

can someone help in #How can someone fix this sending subject to discord webhook!

AAlf can someone help in #How can someone fix this sending subject to discord webhook...

Isaac McFadyen•8/15/24, 8:12 PM

As you've already been told multiple times, please don't crosspost the same question in many different channels.

IIsaac McFadyen As you've already been told multiple times, please don't crosspost the same ques...

Alf•8/15/24, 9:14 PM

bro

Alf•8/15/24, 9:14 PM

it doesnt show inemail worker

akashra•8/16/24, 12:40 AM

I'm looking at the docs on workers rules, but it's not quite clear to me how it's supposed to work - I'm trying to make it so that hitting /foo will use a handler defined in /routes/foo.ts - but have also tried having /foo.ts -is there an example around of how this might work?

Aakashra I'm looking at the docs on workers rules, but it's not quite clear to me how it'...

Isaac McFadyen•8/16/24, 12:41 AM

Workers rules define when to fire a Worker, they don't control which file is run. You'll need a router within the Worker, like https://hono.dev or itty-router.

Hono is a small, simple, and ultrafast web framework for the Edges. It works on Cloudflare Workers, Fastly Compute, Deno, Bun, Vercel, Netlify, AWS Lambda, Lambda@Edge, and Node.js. Fast, but not only fast.

IIsaac McFadyen Workers rules define when to fire a Worker, they don't control which file is run...

akashra•8/16/24, 12:42 AM

ah, okay. That's kinda of what I had been doing until now, defining a route parser and then handing off to a handler class.

akashra•8/16/24, 12:43 AM

Was just hoping to make my code a little more modular and have it so that the parent didnt' need to know about the children explicitly, and could just be inherited by a config. Ultimately the goal was to have routes that were never compiled/deployed in prod.

xtyn•8/16/24, 1:41 AM

no one is helping me bro

xtyn•8/16/24, 1:41 AM

i use cloudflare and when i first download it shows the little task thingy in the bottom right

EErisa if its just one path i'd make two routes, one `example.com/path` and another `ex...

R1CH•8/16/24, 1:43 AM

This isn't allowed it seems. The API throws an error:

Route pattern should not have query parameters [code: 10022]

RR1CH This isn't allowed it seems. The API throws an error: > Route pattern should no...

Chaika•8/16/24, 1:44 AM

yea you can't use query params in routes

Route patterns may not contain infix wildcards or query parameters. For example, neither
example.com/*.jpg
example.com/*.jpg
nor
example.com/?foo=*
example.com/?foo=*
are valid route patterns.

https://developers.cloudflare.com/workers/configuration/routing/routes/

Chaika•8/16/24, 1:45 AM

only way to catch query params is wildcard like the docs quote you linked says

R1CH•8/16/24, 1:46 AM

That's what I was afraid of. I was hoping to avoid doing the route matching in the worker itself since 99% of our hits would not be matching and it'd cost us CPU time for nothing.

Chaika•8/16/24, 1:47 AM

the cpu time should be essentially zero if you check the path and don't execute whatever it is you're doing, inside of the worker itself

Chaika•8/16/24, 1:47 AM

request costs though

R1CH•8/16/24, 1:48 AM

Yeah there's an API on the zone so I was really hoping to avoid that.

R1CH•8/16/24, 1:48 AM

All because marketing wants their ?utm parameters

RR1CH This isn't allowed it seems. The API throws an error: > Route pattern should no...

Erisa•8/16/24, 1:49 AM

oh my bad :(

topmass•8/16/24, 4:52 AM

hey guys im a complete workers noob but have got everything up and running and deployed a few tests and im getting my feet wet, I get that workers aren't going to replace all server functions and you're limited to packages etc, would there be any way by the grace of jebus to be able to extract text from pdf with workers, rust/python/ts anything im open, I can use a server or third party api if I have to but id love to just do it on workers, only need to do 1-3 documents at a time per run and just save the text

Ttopmass hey guys im a complete workers noob but have got everything up and running and d...

akashra•8/16/24, 5:44 AM

If you can write code to execute it anywhere, why wouldn't you be able to do it in a worker?

topmass•8/16/24, 5:45 AM

i don’t know because of limitations of libraries that extract text from pdfs i guess ? also due to my ignorance im pretty dumb programmer just figuring out how everything works one function at a time

topmass•8/16/24, 5:46 AM

no libs natively supported i could see

TheNinthSky•8/16/24, 6:42 AM

I'm generating html responses dynamically depending on the cookies the requesting user has sent (it's something very simple, just inlining some scripts).
Is there a way for the worker to send an ETag header in the generated html response?
Currently is doesn't do that.

ItsWendell•8/16/24, 7:42 AM

Any updates or blog posts coming soon for the new static assets support in Cloudflare Workers?

Ttopmass hey guys im a complete workers noob but have got everything up and running and d...

hfcRed•8/16/24, 7:46 AM

Fetch the pdf then read the response arrayBuffer into a Uint8Array

ThangNV•8/16/24, 8:06 AM

Today, my cloudflare worker not async, so it error

my code is 3 function await but it not wait

Per request. Workers scale(basically) infinitely across multiple devices/requests, but requests from

Similar Threads

Similar Threads

Similar Threads