Are you able to currently export multiple workflows? This seems to work ``` [[workflows]] name = "a

DDanGamble Are you able to currently export multiple workflows? This seems to work ``` [[w...

D

Diogo Ferreira•10/25/24, 11:42 AM

Thank you reporting it @DanGamble let us take a look at it

DDiogo Ferreira Thank you reporting it @DanGamble let us take a look at it

D

DanGambleOP•10/25/24, 11:43 AM

I was hoping to have ~10/15 or so. I can try and bundle them all into 1 for now as they are quite throwaway

DDanGamble Are you able to currently export multiple workflows? This seems to work ``` [[w...

M

Matt Silverlock•10/25/24, 12:02 PM

You can, yes. This looks like a local dev specific bug (which we can fix). This works:

export class FirstWorkflow extends WorkflowEntrypoint<Env, Params> {
    async run(event: WorkflowEvent<Params>, step: WorkflowStep) {
        const files = await step.do('my first step', async () => {
            return {
                inputParams: event,
                files: [],
            };
        });

        const apiResponse = await step.do('some other step', async () => {
            let resp = await fetch('https://api.cloudflare.com/client/v4/ips');
            return await resp.json<any>();
        });
    }
}

export class SecondWorkflow extends WorkflowEntrypoint<Env, Params> {
    async run(event: WorkflowEvent<Params>, step: WorkflowStep) {
        const files = await step.do('some step', async () => {
            return {};
        });

export class FirstWorkflow extends WorkflowEntrypoint<Env, Params> {
    async run(event: WorkflowEvent<Params>, step: WorkflowStep) {
        const files = await step.do('my first step', async () => {
            return {
                inputParams: event,
                files: [],
            };
        });

        const apiResponse = await step.do('some other step', async () => {
            let resp = await fetch('https://api.cloudflare.com/client/v4/ips');
            return await resp.json<any>();
        });
    }
}

export class SecondWorkflow extends WorkflowEntrypoint<Env, Params> {
    async run(event: WorkflowEvent<Params>, step: WorkflowStep) {
        const files = await step.do('some step', async () => {
            return {};
        });

export class FirstWorkflow extends WorkflowEntrypoint<Env, Params> {
    async run(event: WorkflowEvent<Params>, step: WorkflowStep) {
        const files = await step.do('my first step', async () => {
            return {
                inputParams: event,
                files: [],
            };
        });

        const apiResponse = await step.do('some other step', async () => {
            let resp = await fetch('https://api.cloudflare.com/client/v4/ips');
            return await resp.json<any>();
        });
    }
}

export class SecondWorkflow extends WorkflowEntrypoint<Env, Params> {
    async run(event: WorkflowEvent<Params>, step: WorkflowStep) {
        const files = await step.do('some step', async () => {
            return {};
        });

export class FirstWorkflow extends WorkflowEntrypoint<Env, Params> {
    async run(event: WorkflowEvent<Params>, step: WorkflowStep) {
        const files = await step.do('my first step', async () => {
            return {
                inputParams: event,
                files: [],
            };
        });

        const apiResponse = await step.do('some other step', async () => {
            let resp = await fetch('https://api.cloudflare.com/client/v4/ips');
            return await resp.json<any>();
        });
    }
}

export class SecondWorkflow extends WorkflowEntrypoint<Env, Params> {
    async run(event: WorkflowEvent<Params>, step: WorkflowStep) {
        const files = await step.do('some step', async () => {
            return {};
        });

[[workflows]]
name = "first-workflow"
binding = "FIRST_WORKFLOW"
class_name = "FirstWorkflow"

[[workflows]]
name = "second-workflow"
binding = "SECOND_WORKFLOW"
class_name = "SecondWorkflow"

[[workflows]]
name = "first-workflow"
binding = "FIRST_WORKFLOW"
class_name = "FirstWorkflow"

[[workflows]]
name = "second-workflow"
binding = "SECOND_WORKFLOW"
class_name = "SecondWorkflow"

[[workflows]]
name = "first-workflow"
binding = "FIRST_WORKFLOW"
class_name = "FirstWorkflow"

[[workflows]]
name = "second-workflow"
binding = "SECOND_WORKFLOW"
class_name = "SecondWorkflow"

[[workflows]]
name = "first-workflow"
binding = "FIRST_WORKFLOW"
class_name = "FirstWorkflow"

[[workflows]]
name = "second-workflow"
binding = "SECOND_WORKFLOW"
class_name = "SecondWorkflow"

➜  npx wrangler@latest deploy

Total Upload: 1.48 KiB / gzip: 0.62 KiB
Your worker has access to the following bindings:
- Workflows:
  - FIRST_WORKFLOW: FirstWorkflow
  - SECOND_WORKFLOW: SecondWorkflow
Uploaded two-workflows (1.76 sec)

➜  npx wrangler@latest deploy

Total Upload: 1.48 KiB / gzip: 0.62 KiB
Your worker has access to the following bindings:
- Workflows:
  - FIRST_WORKFLOW: FirstWorkflow
  - SECOND_WORKFLOW: SecondWorkflow
Uploaded two-workflows (1.76 sec)

➜  npx wrangler@latest deploy

Total Upload: 1.48 KiB / gzip: 0.62 KiB
Your worker has access to the following bindings:
- Workflows:
  - FIRST_WORKFLOW: FirstWorkflow
  - SECOND_WORKFLOW: SecondWorkflow
Uploaded two-workflows (1.76 sec)

➜  npx wrangler@latest deploy

Total Upload: 1.48 KiB / gzip: 0.62 KiB
Your worker has access to the following bindings:
- Workflows:
  - FIRST_WORKFLOW: FirstWorkflow
  - SECOND_WORKFLOW: SecondWorkflow
Uploaded two-workflows (1.76 sec)

Showing last 3 workflows:
┌───────────────────┬────────────────┬────────────────┬─────────────────────────┬─────────────────────────┐
│ Name              │ Script name    │ Class name     │ Created                 │ Modified                │
├───────────────────┼────────────────┼────────────────┼─────────────────────────┼─────────────────────────┤
│ first-workflow    │ two-workflows  │ FirstWorkflow  │ 10/25/2024, 12:01:24 PM │ 10/25/2024, 12:01:24 PM │
├───────────────────┼────────────────┼────────────────┼─────────────────────────┼─────────────────────────┤
│ second-workflow   │ two-workflows  │ SecondWorkflow │ 10/25/2024, 12:01:24 PM │ 10/25/2024, 12:01:24 PM │
├───────────────────┼────────────────┼────────────────┼─────────────────────────┼─────────────────────────┤
│ workflows-starter │ workflows-demo │ MyWorkflow     │ 10/23/2024, 11:33:58 AM │ 10/24/2024, 7:23:58 PM  │
└───────────────────┴────────────────┴────────────────┴─────────────────────────┴─────────────────────────┘

Showing last 3 workflows:
┌───────────────────┬────────────────┬────────────────┬─────────────────────────┬─────────────────────────┐
│ Name              │ Script name    │ Class name     │ Created                 │ Modified                │
├───────────────────┼────────────────┼────────────────┼─────────────────────────┼─────────────────────────┤
│ first-workflow    │ two-workflows  │ FirstWorkflow  │ 10/25/2024, 12:01:24 PM │ 10/25/2024, 12:01:24 PM │
├───────────────────┼────────────────┼────────────────┼─────────────────────────┼─────────────────────────┤
│ second-workflow   │ two-workflows  │ SecondWorkflow │ 10/25/2024, 12:01:24 PM │ 10/25/2024, 12:01:24 PM │
├───────────────────┼────────────────┼────────────────┼─────────────────────────┼─────────────────────────┤
│ workflows-starter │ workflows-demo │ MyWorkflow     │ 10/23/2024, 11:33:58 AM │ 10/24/2024, 7:23:58 PM  │
└───────────────────┴────────────────┴────────────────┴─────────────────────────┴─────────────────────────┘

Showing last 3 workflows:
┌───────────────────┬────────────────┬────────────────┬─────────────────────────┬─────────────────────────┐
│ Name              │ Script name    │ Class name     │ Created                 │ Modified                │
├───────────────────┼────────────────┼────────────────┼─────────────────────────┼─────────────────────────┤
│ first-workflow    │ two-workflows  │ FirstWorkflow  │ 10/25/2024, 12:01:24 PM │ 10/25/2024, 12:01:24 PM │
├───────────────────┼────────────────┼────────────────┼─────────────────────────┼─────────────────────────┤
│ second-workflow   │ two-workflows  │ SecondWorkflow │ 10/25/2024, 12:01:24 PM │ 10/25/2024, 12:01:24 PM │
├───────────────────┼────────────────┼────────────────┼─────────────────────────┼─────────────────────────┤
│ workflows-starter │ workflows-demo │ MyWorkflow     │ 10/23/2024, 11:33:58 AM │ 10/24/2024, 7:23:58 PM  │
└───────────────────┴────────────────┴────────────────┴─────────────────────────┴─────────────────────────┘

Showing last 3 workflows:
┌───────────────────┬────────────────┬────────────────┬─────────────────────────┬─────────────────────────┐
│ Name              │ Script name    │ Class name     │ Created                 │ Modified                │
├───────────────────┼────────────────┼────────────────┼─────────────────────────┼─────────────────────────┤
│ first-workflow    │ two-workflows  │ FirstWorkflow  │ 10/25/2024, 12:01:24 PM │ 10/25/2024, 12:01:24 PM │
├───────────────────┼────────────────┼────────────────┼─────────────────────────┼─────────────────────────┤
│ second-workflow   │ two-workflows  │ SecondWorkflow │ 10/25/2024, 12:01:24 PM │ 10/25/2024, 12:01:24 PM │
├───────────────────┼────────────────┼────────────────┼─────────────────────────┼─────────────────────────┤
│ workflows-starter │ workflows-demo │ MyWorkflow     │ 10/23/2024, 11:33:58 AM │ 10/24/2024, 7:23:58 PM  │
└───────────────────┴────────────────┴────────────────┴─────────────────────────┴─────────────────────────┘

MMatt Silverlock You can, yes. This looks like a local dev specific bug (which we can fix). This ...

D

DanGambleOP•10/25/24, 12:53 PM

Do you mean this works specifically in production or the

@latest

@latest

works with local dev too?

DDanGamble Do you mean this works specifically in production or the `@latest` works with lo...

D

Diogo Ferreira•10/25/24, 12:54 PM

It will work in production. The bug exists on local dev for the time being

DDanGamble Do you mean this works specifically in production or the `@latest` works with lo...

D

DanGambleOP•10/25/24, 12:54 PM

Just saw this was

deploy

deploy

so assume it still foobars in local dev, thanks @elithrar. Will do 1 big workflow for now as I really only need this to run locally as it's for data migrations/fixtures

D

DanGambleOP•10/25/24, 1:13 PM

Can you have a step within a step or does it all need to be top level?

M

makisuo•10/25/24, 1:17 PM

Just for clarification the 30sec of active CPU time is for the complete workflow and not per Step right?

DDanGamble Can you have a step within a step or does it all need to be top level?

M

Matt Silverlock•10/25/24, 1:35 PM

You can nest steps (try it!)

AAdvany A way around that would be to save it to r2/kv and then use in the next step?

D

dave•10/25/24, 1:37 PM

+1 to using the S3 API, ideally with aws4fetch.

I personally recommend considering Backblaze B2 to use within a Worker, since that way you can have caching on the

fetch

fetch

. (Sadly R2 caching doesn't work within a Worker.) You can also do a server-side mirror with B2 too for high availability, though now that I think about that, it doesn't matter as much with workflows (as they can retry).

MMatt Silverlock This is just early days: it's a beta 🙂

D

dave•10/25/24, 1:38 PM

pfff, that's not gonna stop me from shipping it in prod.

M

makrdev•10/25/24, 2:29 PM

Is there a mechanism to throttle functions that exceed the concurrency limit or we just loose them?

Mmakrdev Is there a mechanism to throttle functions that exceed the concurrency limit or ...

F

fry69•10/25/24, 2:35 PM

I think they just get queued? If they fail, they get also queued for retry? It should not be possible to actually fail hard or get lost unless you programmatically allow this.

C

Chaika•10/25/24, 2:36 PM

any hard retry count/timeout limits? Doesn't appear any are documented

CChaika any hard retry count/timeout limits? Doesn't appear any are documented

F

fry69•10/25/24, 2:37 PM

There are some limits of course -> https://developers.cloudflare.com/workflows/reference/limits/

Ffry69 There are some limits of course -> https://developers.cloudflare.com/workflows/r...

C

Chaika•10/25/24, 2:37 PM

Right, and retry limit/timeout aren't on there

Ffry69 I think they just get queued? If they fail, they get also queued for retry? It s...

D

Diogo Ferreira•10/25/24, 2:38 PM

Precisely this! When the concurrency limits are the reached, new Workflow Instances are queue, until new slots become available

CChaika Right, and retry limit/timeout aren't on there

F

fry69•10/25/24, 2:40 PM

Well, if your workflow constantly fails to do something it will reach the CPU execution time limit at some point

Ffry69 Well, if your workflow constantly fails to do something it will reach the CPU ex...

C

Chaika•10/25/24, 2:41 PM

that's a good point, 30s is a lot though

Original message was deleted

I

itsmatteomanf•10/25/24, 2:42 PM

according to this message though it seems like the 30s cpu time is per step...

CChaika that's a good point, 30s is a lot though

F

fry69•10/25/24, 2:43 PM

You can configure exponential backoff to limit harm -> https://developers.cloudflare.com/workflows/build/sleeping-and-retrying/#retry-steps

Iitsmatteomanf according to this message though it seems like the 30s cpu time is per step...

C

Chaika•10/25/24, 2:44 PM

now I have even more questions about if retries reset that or not lol

CChaika any hard retry count/timeout limits? Doesn't appear any are documented

D

Diogo Ferreira•10/25/24, 2:49 PM

No. You can go like,
{retries: { limit: 1000000, delay: '1 second', backoff: 'constant', }, timeout: '10 minutes'},

This refers to a step config

DDiogo Ferreira No. You can go like, {retries: { limit: 1000000, delay: '1 second',...

C

Chaika•10/25/24, 2:50 PM

Cool, no limits on the timeout part either? Could do '90 years'?
The cpu time is interesting too, Skye seemed to be saying above that it was per step? If so, how do retries work with that?

CChaika Cool, no limits on the timeout part either? Could do '90 years'? The cpu time is...

D

Diogo Ferreira•10/25/24, 2:52 PM

We never tried such a value

But yes, could do 90 years

F

fry69•10/25/24, 2:54 PM

timeout: 'until apocalypse'

CChaika now I have even more questions about if retries reset that or not lol

D

Diogo Ferreira•10/25/24, 2:54 PM

No, they don't reset. If one of a. retries reached or b. timeout reached, the step fails and the workflow will stop as errored

C

Chaika•10/25/24, 2:58 PM

Got it, thanks!

DDiogo Ferreira No, they don't reset. If one of a. retries reached or b. timeout reached, the st...

I

itsmatteomanf•10/25/24, 3:32 PM

Timeout as in the 30s CPU time limit per retry?

I

itsmatteomanf•10/25/24, 3:33 PM

Or the retry timeout in the config?

Iitsmatteomanf Timeout as in the 30s CPU time limit per retry?

D

Diogo Ferreira•10/25/24, 3:34 PM

Per retry, which is, per step. Retries are chances to run the same step, until a successful outcome

DDiogo Ferreira Per retry, which is, per step. Retries are chances to run the same step, until a...

I

itsmatteomanf•10/25/24, 3:35 PM

ok ok, so if a step that takes 20s of cpu time, it will be allowed to run for 20s for 100 retries, if i allow it to, gotcha. And if i have 50 steps, doing 20s of cpu time, i can do 1000s total per workflow (irregardless of retries)

Iitsmatteomanf ok ok, so if a step that takes 20s of cpu time, it will be allowed to run for 20...

D

Diogo Ferreira•10/25/24, 3:37 PM

To clarify, the CPU time of steps that failed are counted towards your quota/billing

M

makrdev•10/25/24, 3:37 PM

Is there a way to execute a cleanup function if a workflow fails?

DDiogo Ferreira To clarify, the CPU time of steps that failed are counted towards your quota/bil...

I

itsmatteomanf•10/25/24, 3:37 PM

billing i assumed so, yeah. quota i'm confused. is it 30s per step, with a total of 30s for all steps summed?

C

Chaika•10/25/24, 3:38 PM

or 30s per step attempt

I

itsmatteomanf•10/25/24, 3:38 PM

yeah, that i'm not clear at all about

Iitsmatteomanf billing i assumed so, yeah. quota i'm confused. is it 30s per step, with a total...

D

Diogo Ferreira•10/25/24, 3:38 PM

Sorry for the confusion. Billing equals quota on my statement

I

itsmatteomanf•10/25/24, 3:38 PM

ok, gotcha

I

itsmatteomanf•10/25/24, 3:38 PM

so, excluding billing (which is the sum of all cpu time consumed, as expected)

I

itsmatteomanf•10/25/24, 3:39 PM

you can have up to 255 steps, each of which can consume up to 30s of cpu time

I

itsmatteomanf•10/25/24, 3:40 PM

each step can be retried indefinitely, each retry resets its counter of 30s (or better, each step retry is like the previous retry never occurred, except for billing purposes, of course)

Mmakrdev Is there a way to execute a cleanup function if a workflow fails?

D

Diogo Ferreira•10/25/24, 3:40 PM

You can always try/catch a step and manage that yourself

C

Chaika•10/25/24, 3:40 PM

https://developers.cloudflare.com/workflows/reference/limits/ is way wrong then about cpu time

C

Chaika•10/25/24, 3:40 PM

Compute time per Workflow | 30 seconds of active CPU time

C

Chaika•10/25/24, 3:40 PM

it says it's for the entire flow

CChaika https://developers.cloudflare.com/workflows/reference/limits/ is way wrong then ...

I

itsmatteomanf•10/25/24, 3:41 PM

yeah, from what i read there it seemed like a workflow could use up to 30s of cpu time, for all steps combined

I

itsmatteomanf•10/25/24, 3:41 PM

didn't clarify the retries, but i always imagined those didn't count, otherwise it'd be impossible to use and guarantee it working correctly

CChaika https://developers.cloudflare.com/workflows/reference/limits/ is way wrong then ...

D

Diogo Ferreira•10/25/24, 3:51 PM

It may be misleading. Remember, you can also perform some work outside any step, directly in the WorkflowEntryPoint.run method. This work is still limited to 30s CPU time

C

Chaika•10/25/24, 3:53 PM

yea, I have a silly potentially abusing workflows use case of checking for an item to propagate. In this case, a worker update. I'm abusing retries and manually throwing errors

Are you able to currently export multiple workflows? This seems to work ``` [[workflows]] name = "a

Similar Threads

Similar Threads

Similar Threads