Is there a limit to how long a worker can run?

PPatrick Star As I said, my suggestion is that it would be nice if sites / templates like Astr...

As an example, here is my blog. It uses the <Picture /><Picture /> element, is deployed on Pages, and is still static: https://github.com/helloimalastair/livin-on-the-edge/blob/e358d668318b3d4d147f866a799e3061c9204720/src/components/Blog/Astralis.astro#L4

GitHub

livin-on-the-edge/src/components/Blog/Astralis.astro at e358d668318...

My Personal Site. Fun Stuff happens here. Contribute to helloimalastair/livin-on-the-edge development by creating an account on GitHub.

JJoeDoe Is there a limit to how long a worker can run?

Hello, I’m Allie!•2/29/24, 10:59 AM

30 seconds of CPU time, and theoretically indefinite runtime, though it may be evicted after 30 seconds

JoeDoeOP•2/29/24, 11:00 AM

oh cpu time is quite different from actual time right?

JoeDoeOP•2/29/24, 11:00 AM

I need my worker to get some data, but the initial 'sync' might take like 10mins+

JJoeDoe oh cpu time is quite different from actual time right?

Hello, I’m Allie!•2/29/24, 11:02 AM

CPU time is time that your Worker is actually doing something. For example, streaming a request to your origin is not counted as CPU Time, but hashing the request body is

JoeDoeOP•2/29/24, 11:03 AM

perfect should be fine then

JJoeDoe perfect should be fine then

Hello, I’m Allie!•2/29/24, 11:04 AM

Though note that 10 minutes might be stretching the limits there. I wouldn’t say it won’t ever work, but I would be wary of expecting it to work every time

vakno•2/29/24, 11:09 AM

I have a parent worker that has service bindings with two child workers that change HTML responses using HTMLRewriter. I want changes that these 2 workers make all applied to the trigger url of parent worker. I cant seem to figure out how to combine responses.
Any help would be appreciated.

HHello, I’m Allie!Are you doing this locally, or deployed?

Old Man Maker•2/29/24, 11:35 AM

@HardlyWorkin' - it's deployed

Old Man Maker•2/29/24, 11:39 AM

Matt just spotted I was missing an await call... FFS. Need a sleep. Thanks for chiming in @HardlyWorkin'

Santosh•2/29/24, 3:11 PM

I am planning to process File uploads with some more parameters using Form Data. Whats the latest status of using form data in workers? I have seen many posts from 2022ish time frame, nothing recent yet. Can someone pl point me to a sample that I can leverage as guidance on how to process form data with Workers/Page functions? I believe this is one of the last posts: https://community.cloudflare.com/t/accessing-a-formdata-object-in-a-cloudflare-workers-function/287517/3

kian•2/29/24, 3:21 PM

Everything on https://developer.mozilla.org/en-US/docs/Web/API/FormData should be accurate.

kian•2/29/24, 3:21 PM

Just use a modern compatibility date and FileFile objects will work fine.

Santosh•2/29/24, 3:22 PM

This article does talk about formdata now being available. If you could pl confirm if this sample should work as is? (I can use R2 instead of B2 of course): https://walshy.dev/blog/21_09_10-handling-file-uploads-with-cloudflare-workers

Handling File Uploads with Cloudflare Workers

This is a tutorial of using the File API to handle file uploads on Cloudflare Workers

kian•2/29/24, 3:23 PM

Yes, FormData will work as you expect.

Dragon•2/29/24, 5:06 PM

Hi Team,
I am building a backend service using itty-router cloudflare and deployed it over the worker. but it is giving cors error when calling from React application. your help will be highly appriciated.

kian•2/29/24, 5:08 PM

Have you taken a look at https://itty.dev/itty-router/cors?

Dragon•2/29/24, 5:41 PM

I did, but let me give it a shot again

Dragon•2/29/24, 5:43 PM

that you!

Dragon•2/29/24, 6:12 PM

I am using this module @cloudflare/itty-router-openapi

Dragon•2/29/24, 6:13 PM

And this code doesn't work with above module

Dragon•2/29/24, 6:13 PM

router
.handle(request, ...args)

// turn any returned raw data into JSON
.then(json)

// catch errors BEFORE corsify
.catch(error)

// corsify all Responses (including errors)
.then(corsify)

Dragon•2/29/24, 6:26 PM

Shall I use plain itty-router instead of "@cloudflare/itty-router-openapi"?

Dragon•2/29/24, 6:26 PM

what do you suggest here?

Rasel Rana Rocky•3/1/24, 6:01 AM

vitestvitest doesn't seem to work with @cloudflare/itty-router-openapi@cloudflare/itty-router-openapi, there's a require()require() call in the .mjs.mjs for js-yamljs-yaml.

quisi.do•3/1/24, 6:27 AM

There are so many ways to read and write data: D1, R2, Analytics engine, KV, logpushd, more?
If I wanted to read and write a counter on every request, what's the best way to do that? E.g. x = x+1.
I'm considering using queues to stack the increments up and bulk process them, which would save a lot on write costs, but I still don't know where to read/write. Or if there's a better way.

Qquisi.do There are so many ways to read and write data: D1, R2, Analytics engine, KV, log...

Hello, I’m Allie!•3/1/24, 6:29 AM

If you just want to be able to increment a counter, I would probably go with Analytics Engine

Original message was deleted

Hello, I’m Allie!•3/1/24, 6:30 AM

Well, if they are just incrementing, then they don’t actually need to read, just write

Hello, I’m Allie!•3/1/24, 6:30 AM

Write a row, then count

Original message was deleted

quisi.do•3/1/24, 6:31 AM

What's the scale issue I'd face with D1? Like a latency issue?

Original message was deleted

Hello, I’m Allie!•3/1/24, 6:31 AM

Yes, but then they gave the example of incrementing a counter

HHello, I’m Allie!Well, if they are just incrementing, then they don’t actually *need* to read, ju...

quisi.do•3/1/24, 6:32 AM

I do need to read. In each request, I'm essentially checking if the value has reached a certain number. It doesn't need to be strictly consistent so I can wait for the bulk process and be off by a few.

Qquisi.do I do need to read. In each request, I'm essentially checking if the value has re...

Hello, I’m Allie!•3/1/24, 6:34 AM

So it is an increment, plus a read? What you could do is push to AE, then have a cron trigger that checks whether it went over, and pushes that state to KV

Hello, I’m Allie!•3/1/24, 6:34 AM

This has the added benefit of being comparatively scalable

Hello, I’m Allie!•3/1/24, 6:34 AM

Since you aren’t hammering the data store on every request

Original message was deleted

quisi.do•3/1/24, 6:36 AM

Hmm. I don't see it in the limits docs but I hadn't considered throttle limits.

Qquisi.do Hmm. I don't see it in the limits docs but I hadn't considered throttle limits.

Hello, I’m Allie!•3/1/24, 6:37 AM

That one isn’t an imposed limit iirc, but just with how fast D1 can process a query, coupled with the fact that it isn’t multithreaded

HHello, I’m Allie!So it is an increment, plus a read? What you could do is push to AE, then have a...

quisi.do•3/1/24, 6:38 AM

I don't believe I currently have access to DO on free tier. I imagine I'll inevitably require paid tier but right now I'm just building PoCs so the gated services kinda make that hard.

Hello, I’m Allie!•3/1/24, 6:38 AM

You could also use R2, if that is the issue

quisi.do•3/1/24, 6:39 AM

Wrong reply, sorry.

Qquisi.do I don't believe I currently have access to DO on free tier. I imagine I'll inevi...

Hello, I’m Allie!•3/1/24, 6:39 AM

My method doesn’t require a DO?

Hello, I’m Allie!•3/1/24, 6:39 AM

All good

quisi.do•3/1/24, 6:39 AM

I meant the quote above yours.

quisi.do•3/1/24, 6:40 AM