Cloudflare Developers•14mo ago

👋 Can a workflow codebase co-exist inside a Pages repo?

Can a workflow codebase co-exist inside a Pages repo?

Sskip 👋 Can a workflow codebase co-exist inside a Pages repo?

fry69•10/31/24, 4:41 AM

wrangler will deploy those to different entities in Cloudflare, so it should not matter where they reside on your side.

fry69•10/31/24, 4:42 AM

You might face problems linking such a repo from the dashboard though, maybe it still works with custom build commands?

Avi•10/31/24, 5:06 AM

it looks like

workerd

workerd

crashes when more than a single workflow is defined in

wrangler.toml

wrangler.toml

Avi•10/31/24, 5:08 AM

ah yeah i see this discussed above

AAvi it looks like `workerd` crashes when more than a single workflow is defined in `...

fry69•10/31/24, 5:09 AM

It should be possible to use separate

wrangler.toml

wrangler.toml

files in separate directories and invoke wrangler separately in those directories with npm scripts.

fry69•10/31/24, 5:10 AM

Maybe even go full monorepo

Ffry69 It should be possible to use separate `wrangler.toml` files in separate director...

Avi•10/31/24, 5:10 AM

but how would those get deployed?

Avi•10/31/24, 5:10 AM

i'd want them tied to the worker i'm deploying with the main

wrangler.toml

wrangler.toml

AAvi but how would those get deployed?

fry69•10/31/24, 5:10 AM

To different Cloudflare names/entities?

Avi•10/31/24, 5:11 AM

i'm not trying to change our deployed infra to workaround a wrangler bug lol

Avi•10/31/24, 5:11 AM

i'm just gonna comment one out at a time

AAvi it looks like `workerd` crashes when more than a single workflow is defined in `...

DiamondDragon•10/31/24, 5:30 AM

ugh i spent like an hour today trying to figure out why i could get the worker server to start... added a 2nd test workflow to play around

Avi•10/31/24, 5:33 AM

yeah it’s rough. imo they should have added a note in the changelog or something

DiamondDragon•10/31/24, 5:36 AM

is it possible to inspect a workflow triggered locally?

Avi•10/31/24, 5:36 AM

i’d also love to know this

DiamondDragon•10/31/24, 5:37 AM

running nr wrangler workflows instances describe test latestnr wrangler workflows instances describe test latest shows the last deployed instance

Mm0c I have a question how workflows are "versioned' Lets say a workflow has 3 steps ...

fry69•10/31/24, 6:00 AM

Running workflows will not get updated of course, only freshly instantiated workflows will run the new deployed version.

DiamondDragon•10/31/24, 6:28 AM

Not sure if this is silly - does it make ense to use a RPC service binding in a workflow/step? getting TypeError: Cannot read properties of undefined (reading 'TEST_SERVICE') TypeError: Cannot read properties of undefined (reading 'TEST_SERVICE') when just testing around

bkyerv•10/31/24, 6:46 AM

is workflows accessible/supported from inside pages functions?

bkyerv•10/31/24, 6:46 AM

I mean directly via env.[workflow_name] e.g. from astro project. i.e. not via network like fetch(...)

Advany•10/31/24, 9:07 AM

I can't seem to figure out, how do I limit the amount of instances per minute a workflow can ingest? I have browser rendering working inside of the workflows and I want to limit it to only do around 1 instance per 10 seconds orso

bkyerv•10/31/24, 9:21 AM

an attempt to delete a workflow from the cli results in an error saying it failed. in the dashboard I have already deleted connected worker but the workflow itself doesn't get deleted regardless of how many times I try to delete it by way of

wrangler workflows delete workflows-starter

wrangler workflows delete workflows-starter

Bbkyerv an attempt to delete a workflow from the cli results in an error saying it faile...

fry69•10/31/24, 9:26 AM

Deleting Workflows is still not possible as far as I know -> workflows

bkyerv•10/31/24, 9:28 AM

why then do they keep this in their docs. thank you for pionting it out though

Bbkyerv why then do they keep this in their docs. thank you for pionting it out though

fry69•10/31/24, 9:30 AM

Nobody told the docu team I guess

Ffry69 Nobody told the docu team I guess 🙂

Advany•10/31/24, 9:53 AM

its a beta... just opened up... lets be kind that they didn't wait till everything was polished

AAdvany its a beta... just opened up... lets be kind that they didn't wait till everythi...

fry69•10/31/24, 9:55 AM

Of course, but it's been a few days since it is officially known, they could have added a note that this is currently not supported IMHO, esp. since this is so prominently mentioned in the docs

Ffry69 Of course, but it's been a few days since it is officially known, they could hav...

Advany•10/31/24, 10:17 AM

yeah, there are also a couple of other things. I think it will get fixed soon (like the create locally needing an id)

bkyerv•10/31/24, 11:49 AM

is it possible to access env vars from inside workflows? e.g. to access db usually a token/url is needed that is saved in the env

Bbkyerv is it possible to access env vars from inside workflows? e.g. to access db usual...

itsmatteomanf•10/31/24, 11:51 AM

Access is the same as a normal worker, but it requires a

this.

this.

before accessing it… it’s not mentioned in the docs, they will add it

bkyerv•10/31/24, 11:53 AM

I see, thank you!

bkyerv•10/31/24, 11:55 AM

in general are there any materials that show cases of proven practices that work well with workflows? i.e. is it better to keep interaction with the db inside the workflow or outside of the workflow in the worker itself. or more generally what actions are better to perform inside workflow vs. inside a regular worker?

AAdvany I can't seem to figure out, how do I limit the amount of instances per minute a ...

Advany•10/31/24, 12:02 PM

I made a workaround. Add the workflow items to a d1. Then a do sends it every 10 seconds to the workflow. Dripping it into it.

Would be great if we could just add that on step level of workflow level

AAdvany I made a workaround. Add the workflow items to a d1. Then a do sends it every 10...

Advany•10/31/24, 12:05 PM

Just though about it now. I could have created a workflow that goes thru the list and sleeps between each entry...

Bbkyerv in general are there any materials that show cases of proven practices that work...

itsmatteomanf•10/31/24, 12:24 PM

The less work each step makes, the better. Each step will be retried, persisting results from other steps, but not variables outside of those (so the variable assigned from a step return is maintained, a random variable is not)

itsmatteomanf•10/31/24, 12:24 PM

Do a db step, do a processing step (or even a per item processing, if it’s a loop and it’s not too long to go over the step limit)

itsmatteomanf•10/31/24, 12:25 PM

Do consider that you can nest steps, too. If you were to need that.

bkyerv•10/31/24, 12:36 PM

thank you

Iitsmatteomanf Do a db step, do a processing step (or even a per item processing, if it’s a loo...

DiamondDragon•10/31/24, 2:35 PM

Isn’t the step limit 250? So I have a step that return an object of 500 items and need to loop over each item to make another external api call and do further processing, I can’t have a nested step inside the for loop to process each item? Since it sounds like I’d hit the step limit

DDiamondDragon Isn’t the step limit 250? So I have a step that return an object of 500 items an...

itsmatteomanf•10/31/24, 2:56 PM

Exactly, yes. The limit is 255 steps.

itsmatteomanf•10/31/24, 2:56 PM

Do remember that you still have the 1k subrequest limit that applies and that retries will be counted against this limit.

DanGamble•10/31/24, 2:59 PM

Has multiple workflows with local wrangler been "fixed" yet? I can't see any issues in the

wrangler-sdk

wrangler-sdk

repo. Shall I create one if it's not been fixed? Not sure where the state of this bug would be kept

DDanGamble Has multiple workflows with local wrangler been "fixed" yet? I can't see any iss...

DiamondDragon•10/31/24, 3:13 PM

still broken as of last night since i ran into it

Iitsmatteomanf Exactly, yes. The limit is 255 steps.

DiamondDragon•10/31/24, 3:14 PM

Hmm maybe i'll process 10 at a time then

movaid7•10/31/24, 3:54 PM

I haven't seen this mentioned anywhere in the docs - I can't figure out if sleeping executions are counted towards the concurrency limit.
general-helpDo sleeping Workflows count towards the maximum concurrent execution limit?

saba•10/31/24, 8:13 PM

Is there a way to have a monorepo of several workflows in one repository ?

saba•10/31/24, 8:34 PM

is someone succeded with same setup as for workers?

Ssaba Is there a way to have a monorepo of several workflows in one repository ?

Matt Silverlock•11/1/24, 1:43 PM

Yes, but right now that is broken in local dev. Search this channel for “multiple Workflows”

MMatt Silverlock Yes, but right now that is broken in local dev. Search this channel for “multipl...

Matt Silverlock•11/1/24, 1:48 PM

workflows

👋 Can a workflow codebase co-exist inside a Pages repo?

Similar Threads

Similar Threads

Similar Threads