Furthermore, I think `await stream.write(...)` rejects immediately if the client is disconnected, ho

Furthermore, I think

await stream.write(...)

await stream.write(...)

await stream.write(...)

await stream.write(...) rejects immediately if the client is disconnected, however if subclassing a

ReadableStream

ReadableStream

ReadableStream

ReadableStream, then

controller.enqueue(...)

controller.enqueue(...)

controller.enqueue(...)

controller.enqueue(...) does not throw and neither is

underlyingSource.cancel()

underlyingSource.cancel()

underlyingSource.cancel()

underlyingSource.cancel() called when the client disconnects?

Deo Kumar•8/14/24, 6:29 AM

is the new assets binding live?

DDeo Kumar is the new assets binding live?

ItsWendell•8/14/24, 11:27 AM

Also can't wait for this, a date that was mentioned in one if the github commits related to this was 15th, which is tomorrow

Stoke•8/14/24, 12:03 PM

Does anyone know of any kind of example on how to deploy PR environments with slug urls similar to how pages does it? using Pages, I can wrangler pages deploy --branch=pr123wrangler pages deploy --branch=pr123 and it will automatically wire the previewpreview environment with URL pr123.mypage.pages.devpr123.mypage.pages.dev. I'm struggling to do the same with a worker, because the environment and routes have to be specified in wrangler.toml. I'd be fine with deploying to the same previewpreview env (for the variables), but then I'd need the route with the slug (pr123pr123) to be updated to always point to the correct deployment ID. There will be multiple PRs active at the same time. Thanks!

Zack•8/14/24, 4:00 PM

Hey, trying to optimise a worker that I have to use less memory (as we are seeing out of memory errors) by streaming responses from KV instead of pulling the entire 3MB value into memory. Seeing some huge performance issues after making these changes though, requests taking 25 seconds in our test environment, but locally this all run quickly. I was wondering how cloudflare workers scale when they get hit with a lot of concurrent requests to a single edge region. Also, there are limits on 6 external requests at once, including to R2 and KV, is that per request or per worker?

ZZack Hey, trying to optimise a worker that I have to use less memory (as we are seein...

Hard@Work•8/14/24, 4:02 PM

Per request. Workers scale(basically) infinitely across multiple devices/requests, but requests from the same device/client may share a single isolate

HHard@Work Per request. Workers scale(basically) infinitely across multiple devices/request...

Zack•8/14/24, 4:02 PM

I see, that could explain the issues we're seeing then. Why may they share the same isolate when from the same device/client?

Zack•8/14/24, 4:03 PM

Debugging this is proving a huge pain, especially as I can't get performance metrics for the CPU based part of the functions

ZZack I see, that could explain the issues we're seeing then. Why may they share the s...

Hard@Work•8/14/24, 4:05 PM

Connection Affinity. Basically, when you make multiple requests to a Cloudflare-protected website, your browser(or other client) may store information about the connection(which server you are connected to), so that you continue to connect to the same server over multiple requests. If you make multiple requests to the same machine for a Worker then they share an isolate(unless it is overloaded, iirc)

Hard@Work•8/14/24, 4:07 PM

Sorry if this sounds confusing, I'm not sure I've worded it as clearly as can be

HHard@Work Connection Affinity. Basically, when you make multiple requests to a Cloudflare-...

Zack•8/14/24, 4:07 PM

I see. Have you got any suggestions on how to understand what's causing the performance problems we're seeing? I'm basically stuck between a rock and a hard place right now. Our currently implementation uses too much memory, but the new implementation causes this strange behaviour

ZZack I see. Have you got any suggestions on how to understand what's causing the perf...

Hard@Work•8/14/24, 4:08 PM

DevTools might be of use here? https://developers.cloudflare.com/workers/testing/debugging-tools/#chrome-devtools

Cloudflare Docs

Debugging tools | Cloudflare Workers docs

Debug your local and deployed Workers using a variety of tools.

Zack•8/14/24, 4:08 PM

We basically store 3MB "lookup tables" in KV, previously we pulled these into memory, but with high concurrent request count that causes out of memory issues. So we are trying to stream the lookup table and process them per entry so we only use 64KiB per request (for the buffer)

Zack•8/14/24, 4:08 PM

But while doing that I am seeing super weird behaviour like the R2 requests taking 10 seconds or even 25 seconds alone sometimes

Zack•8/14/24, 4:09 PM

Which is where my theories about contention came in

Zack•8/14/24, 4:09 PM

I'll try to get that debugging working remotely

HHard@Work DevTools might be of use here? https://developers.cloudflare.com/workers/testing...

Zack•8/14/24, 4:51 PM

Sorry, one more thing, the really odd behaviour is this

Zack•8/14/24, 4:51 PM

The requests all get stuck for a while, and then basically all come back at the same instant

Zack•8/14/24, 4:52 PM

Zack•8/14/24, 4:52 PM

That's the call to R2

Brett WillisOP•8/14/24, 10:15 PM

ReadableStreamBYOBReader.readAtLeast(minBytes, bufferArrayBufferView)ReadableStreamBYOBReader.readAtLeast(minBytes, bufferArrayBufferView) as per
https://developers.cloudflare.com/workers/runtime-apis/streams/readablestreambyobreader/#methods says:

Returns a promise with the next available chunk of data read into a passed-in buffer. The promise will not resolve until at least minBytes have been read.

What happens if the source stream ends with less than minBytesminBytes available? A little bit of sanity would say that it would resolve with the buffer partially filled with the available bytes, rather than rejecting, but that contradicts the absolute statement "The promise will not resolve until at least minBytes have been read". Can someone confirm and perhaps update the docs?

Yakuzo•8/15/24, 10:24 AM

Hello, I have a question about Workers pricing. There is a line written in the pricing for inter-worker sub-requests that they are not charged.

 Inbound requests to your Worker. Cloudflare does not bill for subrequests you make from your Worker.

 Inbound requests to your Worker. Cloudflare does not bill for subrequests you make from your Worker.

https://developers.cloudflare.com/workers/platform/pricing/
Just to make sure I understand, this means that if I make a request to a worker from a client and this worker needs to call two other workers in JsRPC, this will count as a single request (but will bill me for the execution time in ms on all the workers), right? Or have I misunderstood?

Cloudflare Docs

Pricing | Cloudflare Workers docs

Workers plans and pricing information.

Alf•8/15/24, 12:32 PM

beg someone helps me setup #How can someone fix this sending subject to discord webhook!

ArmoredCavalry•8/15/24, 12:57 PM

Had a couple questions on the Snippets alpha. Does anyone know if 1) There are plans to add analytics / logging for when a Snippet Worker runs into a resource limit error? 2) Plans to allow for async actions, to execute after the response has been returned (like a full Worker)?

AArmoredCavalry Had a couple questions on the Snippets alpha. Does anyone know if 1) There are p...

Alf•8/15/24, 1:42 PM

ion kno

AArmoredCavalry Had a couple questions on the Snippets alpha. Does anyone know if 1) There are p...

Alf•8/15/24, 1:47 PM

Alf•8/15/24, 1:47 PM

if i can get mine to work

Alf•8/15/24, 1:47 PM

ill do updates for it

Alf•8/15/24, 5:44 PM

someone come help in #How can someone fix this sending subject to discord webhook!

Alf•8/15/24, 8:06 PM

can someone help in #How can someone fix this sending subject to discord webhook!

AAlf can someone help in #How can someone fix this sending subject to discord webhook...

Isaac McFadyen•8/15/24, 8:12 PM

As you've already been told multiple times, please don't crosspost the same question in many different channels.

IIsaac McFadyen As you've already been told multiple times, please don't crosspost the same ques...

Alf•8/15/24, 9:14 PM

bro

Alf•8/15/24, 9:14 PM

it doesnt show inemail worker

akashra•8/16/24, 12:40 AM

I'm looking at the docs on workers rules, but it's not quite clear to me how it's supposed to work - I'm trying to make it so that hitting /foo will use a handler defined in /routes/foo.ts - but have also tried having /foo.ts -is there an example around of how this might work?

Aakashra I'm looking at the docs on workers rules, but it's not quite clear to me how it'...

Isaac McFadyen•8/16/24, 12:41 AM

Workers rules define when to fire a Worker, they don't control which file is run. You'll need a router within the Worker, like https://hono.dev or itty-router.

Hono is a small, simple, and ultrafast web framework for the Edges. It works on Cloudflare Workers, Fastly Compute, Deno, Bun, Vercel, Netlify, AWS Lambda, Lambda@Edge, and Node.js. Fast, but not only fast.

IIsaac McFadyen Workers rules define when to fire a Worker, they don't control which file is run...

akashra•8/16/24, 12:42 AM

ah, okay. That's kinda of what I had been doing until now, defining a route parser and then handing off to a handler class.

akashra•8/16/24, 12:43 AM

Was just hoping to make my code a little more modular and have it so that the parent didnt' need to know about the children explicitly, and could just be inherited by a config. Ultimately the goal was to have routes that were never compiled/deployed in prod.

xtyn•8/16/24, 1:41 AM

no one is helping me bro

xtyn•8/16/24, 1:41 AM

i use cloudflare and when i first download it shows the little task thingy in the bottom right

EErisa if its just one path i'd make two routes, one `example.com/path` and another `ex...

R1CH•8/16/24, 1:43 AM

This isn't allowed it seems. The API throws an error:

Route pattern should not have query parameters [code: 10022]

RR1CH This isn't allowed it seems. The API throws an error: > Route pattern should no...

Chaika•8/16/24, 1:44 AM

yea you can't use query params in routes

Route patterns may not contain infix wildcards or query parameters. For example, neither example.com/*.jpgexample.com/*.jpg nor example.com/?foo=* example.com/?foo=* are valid route patterns.

https://developers.cloudflare.com/workers/configuration/routing/routes/

Chaika•8/16/24, 1:45 AM

only way to catch query params is wildcard like the docs quote you linked says

R1CH•8/16/24, 1:46 AM

That's what I was afraid of. I was hoping to avoid doing the route matching in the worker itself since 99% of our hits would not be matching and it'd cost us CPU time for nothing.

Chaika•8/16/24, 1:47 AM

the cpu time should be essentially zero if you check the path and don't execute whatever it is you're doing, inside of the worker itself

Chaika•8/16/24, 1:47 AM

request costs though

R1CH•8/16/24, 1:48 AM

Yeah there's an API on the zone so I was really hoping to avoid that.

R1CH•8/16/24, 1:48 AM

All because marketing wants their ?utm parameters

RR1CH This isn't allowed it seems. The API throws an error: > Route pattern should no...

Erisa•8/16/24, 1:49 AM

oh my bad :(

topmass•8/16/24, 4:52 AM

hey guys im a complete workers noob but have got everything up and running and deployed a few tests and im getting my feet wet, I get that workers aren't going to replace all server functions and you're limited to packages etc, would there be any way by the grace of jebus to be able to extract text from pdf with workers, rust/python/ts anything im open, I can use a server or third party api if I have to but id love to just do it on workers, only need to do 1-3 documents at a time per run and just save the text

Ttopmass hey guys im a complete workers noob but have got everything up and running and d...

akashra•8/16/24, 5:44 AM

If you can write code to execute it anywhere, why wouldn't you be able to do it in a worker?

topmass•8/16/24, 5:45 AM

i don’t know because of limitations of libraries that extract text from pdfs i guess ? also due to my ignorance im pretty dumb programmer just figuring out how everything works one function at a time

Furthermore, I think `await stream.write(...)` rejects immediately if the client is disconnected, ho

Similar Threads

Similar Threads

Similar Threads