Hey there! Is there any possibility of running some of the steps of a workflow in parallel? For exam

LLila Rest Hey there! Is there any possibility of running some of the steps of a workflow i...

M

You can always fire off another Workflow, even from within a Workflow. Workflows are the way to run tasks concurrently, or in parallel.

B

Bonadio•1/21/25, 6:36 PM

Hi, what is the use of the return of the run function in the workflow?
I saw in the twillio example that it returns a value.
https://github.com/craigsdennis/twilio-cloudflare-workflow/blob/main/src/index.ts

export class NeverGonnaWorkflow extends WorkflowEntrypoint<Env, NeverGonnaParams> {
    async run(event: WorkflowEvent<NeverGonnaParams>, step: WorkflowStep) {
        const { to, host, content } = event.payload;
        await step.sleep('wait for the right moment', '135 seconds');
        const callSid = await step.do('call person back', async () => {
            const client = new Twilio(this.env.TWILIO_ACCOUNT_SID, this.env.TWILIO_AUTH_TOKEN);
            // Say verb here does text to speech
            // Play allows you to play media.
            // The mp3 file is hosted on Cloudflare Workers using dynamic assets
            const twiml = `
            <Response>
                <Say>Hello from a Cloudflare Workflow!</Say>
                <Say>You said "${content}".</Say>
                <Say>Check out this classic:</Say>
                <Play>https://${host}/classic.mp3</Play>
            </Response>`;
            const call = await client.calls.create({
                to,
                from: this.env.TWILIO_PHONE_NUMBER,
                twiml,
            });
            return call.sid;
        });

        return { success: true, callSid };   // <------ How to use this?

    }
}

export class NeverGonnaWorkflow extends WorkflowEntrypoint<Env, NeverGonnaParams> {
    async run(event: WorkflowEvent<NeverGonnaParams>, step: WorkflowStep) {
        const { to, host, content } = event.payload;
        await step.sleep('wait for the right moment', '135 seconds');
        const callSid = await step.do('call person back', async () => {
            const client = new Twilio(this.env.TWILIO_ACCOUNT_SID, this.env.TWILIO_AUTH_TOKEN);
            // Say verb here does text to speech
            // Play allows you to play media.
            // The mp3 file is hosted on Cloudflare Workers using dynamic assets
            const twiml = `
            <Response>
                <Say>Hello from a Cloudflare Workflow!</Say>
                <Say>You said "${content}".</Say>
                <Say>Check out this classic:</Say>
                <Play>https://${host}/classic.mp3</Play>
            </Response>`;
            const call = await client.calls.create({
                to,
                from: this.env.TWILIO_PHONE_NUMBER,
                twiml,
            });
            return call.sid;
        });

        return { success: true, callSid };   // <------ How to use this?

    }
}

export class NeverGonnaWorkflow extends WorkflowEntrypoint<Env, NeverGonnaParams> {
    async run(event: WorkflowEvent<NeverGonnaParams>, step: WorkflowStep) {
        const { to, host, content } = event.payload;
        await step.sleep('wait for the right moment', '135 seconds');
        const callSid = await step.do('call person back', async () => {
            const client = new Twilio(this.env.TWILIO_ACCOUNT_SID, this.env.TWILIO_AUTH_TOKEN);
            // Say verb here does text to speech
            // Play allows you to play media.
            // The mp3 file is hosted on Cloudflare Workers using dynamic assets
            const twiml = `
            <Response>
                <Say>Hello from a Cloudflare Workflow!</Say>
                <Say>You said "${content}".</Say>
                <Say>Check out this classic:</Say>
                <Play>https://${host}/classic.mp3</Play>
            </Response>`;
            const call = await client.calls.create({
                to,
                from: this.env.TWILIO_PHONE_NUMBER,
                twiml,
            });
            return call.sid;
        });

        return { success: true, callSid };   // <------ How to use this?

    }
}

export class NeverGonnaWorkflow extends WorkflowEntrypoint<Env, NeverGonnaParams> {
    async run(event: WorkflowEvent<NeverGonnaParams>, step: WorkflowStep) {
        const { to, host, content } = event.payload;
        await step.sleep('wait for the right moment', '135 seconds');
        const callSid = await step.do('call person back', async () => {
            const client = new Twilio(this.env.TWILIO_ACCOUNT_SID, this.env.TWILIO_AUTH_TOKEN);
            // Say verb here does text to speech
            // Play allows you to play media.
            // The mp3 file is hosted on Cloudflare Workers using dynamic assets
            const twiml = `
            <Response>
                <Say>Hello from a Cloudflare Workflow!</Say>
                <Say>You said "${content}".</Say>
                <Say>Check out this classic:</Say>
                <Play>https://${host}/classic.mp3</Play>
            </Response>`;
            const call = await client.calls.create({
                to,
                from: this.env.TWILIO_PHONE_NUMBER,
                twiml,
            });
            return call.sid;
        });

        return { success: true, callSid };   // <------ How to use this?

    }
}

GitHub

twilio-cloudflare-workflow/src/index.ts at main · craigsdennis/twil...

Use Cloudflare Workers to create a scheduled durable execution with your Twilio applications - craigsdennis/twilio-cloudflare-workflow

BBonadio Hi, what is the use of the return of the run function in the workflow? I saw in...

M

Matt Silverlock•1/21/25, 6:51 PM

You can capture that value when you inspect an instances’ status. This can be useful if your Workflow is computing some kind of result, storing data against a key, or generating some kind of identifier

MMatt Silverlock You can always fire off another Workflow, even from within a Workflow. Workflows...

L

Lila RestOP•1/22/25, 8:31 AM

Thanks Matt! And will this new workflow run in the same thread or in another?
I know that workers called from other workers will run on the same resources. We are executing a huge tree of operations and I’m trying to maximize the speed of execution.

LLila Rest Thanks Matt! And will this new workflow run in the same thread or in another? I ...

M

Matt Silverlock•1/22/25, 11:03 AM

That wont affect it here.

MMatt Silverlock That wont affect it here.

L

Lila RestOP•1/22/25, 3:31 PM

To be 100% sure you're saying that calling a workflow from another will happen in two separate threads?

LLila Rest To be 100% sure you're saying that calling a workflow from another will happen i...

M

Matt Silverlock•1/22/25, 3:39 PM

I'm saying it's no different from any other Worker invocation. If the Workflow is a different Workflow (script) then it is likely to spawn a new isolate. We don't make any more guarantees than that.

MMark Hey all. Does anyone know what token permission is required to create a new wor...

M

Matt Silverlock•1/23/25, 5:59 PM

Workers scripts edit + read:

MMatt Silverlock I'm saying it's no different from any other Worker invocation. If the Workflow i...

L

Lila RestOP•1/24/25, 9:08 AM

Ah I see, all clear!

MMatt Silverlock Can you share your account ID here? (it’s safe to share publicly)

M

m.muiznieks•1/26/25, 3:08 PM

Yes, I've noticed the same thing for me as well.
Also the response that request is queued comes after 60-80s.

The time until START of the step since receiving is 40+ minutes. :))

(thats the reason I came here for looking is this an issue for anyone else).

My account ID: 5e3dea7b807381cba36b9292bde14920

Additionally I can say that even sending the requests to my workflow worker gets even 60 to 90 seconds to receive any response from them. Is this a feature? I was not aware of this before.

A

Aslak Hellesoy•1/26/25, 10:12 PM

Hi all. Is it possible to pause/resume workflow steps and wait for user input?

We're using workflows for order processing. For new users, we require that the user verifies their identity with an external KYC provider. Is there a way to wrap this in a step that will block until the user has verified their identity? Some kind of signal mechanism similar to what Temporal has?

Thanks in advance.

Mm.muiznieks Yes, I've noticed the same thing for me as well. Also the response that request...

M

m.muiznieks•1/27/25, 2:30 AM

Also... around 60 instances are marked as queued. But none shows up at any time window. Are there any possibilities to "restart" the workflow?

C

Chris Jayden•1/27/25, 8:13 AM

I'm running a workflow to do some R2 work. However, when I'm not running

--remote

--remote

, no real operations are taking place on my buckets. So calling

list

list

doesn't return anything.

however, when i do run

--remote

--remote

and call my worfklow, i get a

workflow.not_found

workflow.not_found

.

Is there something I'm missing?

CChris Jayden I'm running a workflow to do some R2 work. However, when I'm not running `--remo...

H

Hello, I’m Allie!•1/27/25, 8:17 AM

Afaik, remote mode doesn’t work for Workflows yet

HHello, I’m Allie!Afaik, remote mode doesn’t work for Workflows yet

C

Chris Jayden•1/27/25, 8:18 AM

Thanks for chiming in. Any other way to test my workflows w/ R2?

CChris Jayden Thanks for chiming in. Any other way to test my workflows w/ R2?

H

Hello, I’m Allie!•1/27/25, 8:21 AM

You should be able to do lists in local mode, via the CLI, if that is what you mean?

HHello, I’m Allie!You should be able to do lists in local mode, via the CLI, if that is what you m...

C

Chris Jayden•1/27/25, 10:02 AM

I'm trying to query my file in my worker during a workflow. So env.MY_BUCKET.get() or env.MY_BUCKET.list(). But it won't return actual files since I'm developing locally, but i can't set it to

--remote

--remote

because workflows are not supported in remote

CChris Jayden I'm trying to query my file in my worker during a workflow. So env.MY_BUCKET.get...

H

Hello, I’m Allie!•1/27/25, 10:42 AM

Yes, you would need to seed the local store with data

HHello, I’m Allie!Yes, you would need to seed the local store with data

C

Chris Jayden•1/27/25, 10:55 AM

Ohhhhh you can do that? Cool. i didn't know. Thanks that helps

C

Chris Jayden•1/27/25, 11:00 AM

Another question, is it fine to map promises like this with Cloudflare workflows?

const uploads = await Promise.all(
    batch.map(async (image, index) => {
        // Add 1 second sleep between uploads, but not before the first one
        if (index > 0) {
            await step.sleep(`delay-upload-${i}-${index}`, "1 second");
        }

        return step.do(
            `process-image-${i}`,
            {
                retries: {
                    limit: 3,
                    delay: "5 seconds",
                    backoff: "exponential",
                },
            },
            () => this.downloadAndUploadImage(image, orgId)
        );
    })
);

const uploads = await Promise.all(
    batch.map(async (image, index) => {
        // Add 1 second sleep between uploads, but not before the first one
        if (index > 0) {
            await step.sleep(`delay-upload-${i}-${index}`, "1 second");
        }

        return step.do(
            `process-image-${i}`,
            {
                retries: {
                    limit: 3,
                    delay: "5 seconds",
                    backoff: "exponential",
                },
            },
            () => this.downloadAndUploadImage(image, orgId)
        );
    })
);

const uploads = await Promise.all(
    batch.map(async (image, index) => {
        // Add 1 second sleep between uploads, but not before the first one
        if (index > 0) {
            await step.sleep(`delay-upload-${i}-${index}`, "1 second");
        }

        return step.do(
            `process-image-${i}`,
            {
                retries: {
                    limit: 3,
                    delay: "5 seconds",
                    backoff: "exponential",
                },
            },
            () => this.downloadAndUploadImage(image, orgId)
        );
    })
);

const uploads = await Promise.all(
    batch.map(async (image, index) => {
        // Add 1 second sleep between uploads, but not before the first one
        if (index > 0) {
            await step.sleep(`delay-upload-${i}-${index}`, "1 second");
        }

        return step.do(
            `process-image-${i}`,
            {
                retries: {
                    limit: 3,
                    delay: "5 seconds",
                    backoff: "exponential",
                },
            },
            () => this.downloadAndUploadImage(image, orgId)
        );
    })
);

F

Flogert Çiku•1/28/25, 5:40 PM

Hey there ? Is there possible to add workflows inside an existing worker ?

FFlogert Çiku Hey there ? Is there possible to add workflows inside an existing worker ?

A

Ashley•1/28/25, 5:43 PM

Yes, you just need to export the class that implements your workflow and set the appropriate bindings in wrangler.toml as per the docs

F

Flogert Çiku•1/28/25, 5:45 PM

@Ashley thanks, the idea is that some functionalities of the worker to be executed as workflow steps.
and also the existing worker is in js, so far there is only documentation in .ts

D

D Trombett•1/29/25, 6:22 PM

For how long after a workflow is finished,

WORKFLOW.get(id)

WORKFLOW.get(id)

will return the finished instance? Also, does

.restart()

.restart()

work for finished workflows too?

Mm.muiznieks Yes, I've noticed the same thing for me as well. Also the response that request...

M

m.muiznieks•1/29/25, 7:46 PM

I am on the Workers paid plan.

For at least 3 - 4 days I see that the workflows are flowing... not as expected.

They build up a massive queue (which seems to grow bigger day by day) and have long inactivity periods (as visible on the screen—before that, there was no activity for 1h+). Meanwhile, usually I've not seen more than 28 instances running, in rare cases they hit at one moment higher, but havent seen near 100.

The workflow itself contains just one simple request (to Meta conversion API), so there is nothing resource-demanding (because I'm testing if and how to scale the workflow usage).

At the error logs I see that the requests might fail due to "Durable Object restarting," because of some code updates. Thats cool, but I'm just waiting when this queue will be "errored" when the wrong timing hits.

So my concerns and question is - are there some other limits that must be taken in mind when building the Workflows? Or is this some issue related to my account or what?

I understand that it's low possibility to get an answer here, but I still hope on that. :))

Thank you .

Mm.muiznieks I am on the Workers paid plan. For at least 3 - 4 days I see that the workflow...

M

m.muiznieks•1/29/25, 7:58 PM

Addition to previous post - here is the situation on another Flow - queue just getting bigger, but nothing is processed. It feels like that only one workflow connected to the worker is running. Did I miss this limit somewhere if its true?

Mm.muiznieks I am on the Workers paid plan. For at least 3 - 4 days I see that the workflow...

S

Seekerdasbatatas•1/29/25, 9:07 PM

Are there any other workflows in your account? Note that the concurrency limit is account wide

SSeekerdasbatatas Are there any other workflows in your account? Note that the concurrency limit i...

M

m.muiznieks•1/29/25, 9:41 PM

No. These are two working workflows, which basically do the same thing.
By looking into possible solutions I divided the requests in half.

That helped a bit, as the active one started to process something and now the queue is slowly decreasing, but the other one - does not do anything, and now is up to 2k in the queue (both waiting queue sums are the same as before and keeps increasing).

For wider context - they are receiving the requests from the Zaraz custom-managed component. But I don't know if it has anything to do with this unless that affects some other underlying processes.

Mm.muiznieks No. These are two working workflows, which basically do the same thing. By look...

S

Seekerdasbatatas•1/29/25, 9:42 PM

Huh weird, thanks for letting us know - can you send your account id for us to investigate?

SSeekerdasbatatas Huh weird, thanks for letting us know - can you send your account id for us to i...

M

m.muiznieks•1/29/25, 9:46 PM

Yes. As already sent before, here it is.

My account ID: 5e3dea7b807381cba36b9292bde14920

S

Seekerdasbatatas•1/29/25, 9:46 PM

Thanks, I'll look into it tomorrow morning

M

m.muiznieks•1/29/25, 9:49 PM

I guess this issue is similar as what's already posted here: workflows @Rakhim

J

Jonathan Riche•1/30/25, 12:06 AM

Do Cloudflare workers bindings/apis work inside Workflows ie the AI binding?

Original message was deleted

J

Jonathan Riche•1/30/25, 1:00 AM

Awesome thx

SSeekerdasbatatas Thanks, I'll look into it tomorrow morning

M

m.muiznieks•1/30/25, 1:41 AM

What I can add now after looking at the tendency, it is somehow related to the incoming requests to the workflow. Now, after the peak hours are over, the processing tempo has increased proportionally to the decrease in new requests.

I hope this somehow helps investigate further and find a solution.

DD Trombett For how long after a workflow is finished, `WORKFLOW.get(id)` will return the fi...

D

D Trombett•1/30/25, 11:26 AM

D

D Trombett•1/30/25, 11:26 AM

Bumping this in case anyone knows

DD Trombett Empty message

S

Seekerdasbatatas•1/30/25, 11:45 AM

On limits, we advertise 3 days on free and 30 days on paid (although this is not enforced atm, but could change at any moment)(https://developers.cloudflare.com/workflows/reference/limits/)

.restart()

.restart()

is not implemented yet

Cloudflare Docs

Limits · Cloudflare Workflows docs

Limits that apply to authoring, deploying, and running Workflows are detailed below.

D

D Trombett•1/30/25, 11:46 AM

Ok, thanks!

K

kchro3•1/30/25, 9:48 PM

Hi folks, we're seeing that if you execute a sleep step, it takes a few minutes to change states from running to waiting, and that backs up the queue pretty significantly. Would someone be able to explain in more detail why this would happen under the hood and what we should expect?

M

Mitya•1/31/25, 1:12 PM

Hi - I'm new to Workflows. I'm a little lost in the various ways of doing things and am trying to understand how Workflows differs from other approaches to task distribution. In what situations would Workflows be preferable instead of, say, worker service bindings, or queues? Both allow tasks to be distributed and run asynchronously. A really simple use-case example would be appreciated.

Mm.muiznieks What I can add now after looking at the tendency, it is somehow related to the i...

S

Seekerdasbatatas•1/31/25, 6:53 PM

To keep you posted, the bug has been identified and will be rolling out throughout next week probably

L

Luke•1/31/25, 7:27 PM

Is there an easy way to debug workflows in vs code? In my workers project I can just use the

javascript debug terminal

javascript debug terminal

and it works fine. For some reason it doesn't w/ workflows - all of my breakpoints are "unbound"

LLuke Is there an easy way to debug workflows in vs code? In my workers project I can ...

L

Luke•1/31/25, 7:35 PM

Disregard - i forgot that w/ workers I don't use the

javascript debug terminal

javascript debug terminal

I have to run

wrangler dev

wrangler dev

and then attach vs code to the process. The same works fine w/ workflows.

L

Luke•1/31/25, 7:36 PM

Next question I have is - how can I restart a failed workflow? I tried using

instance.restart

instance.restart

,

instance.terminate

instance.terminate

, etc. and it says

Not implemented yet

Not implemented yet

. Any tips on that?

Kkchro3 Hi folks, we're seeing that if you execute a sleep step, it takes a few minutes ...

S

Seekerdasbatatas•1/31/25, 7:58 PM

It's an implementation detail for workflows - we need to allow some time for top level work, this time might get reduced before GA, but for beta we were more generous because of correctness (because it's JS, you can do some really weird stuff with control flow in a relatively easy way

)

S

Seekerdasbatatas•1/31/25, 7:59 PM

We hopefully are

a bunch of stuff next week that will make the queuing aspect better :soontm:

L

Luke•2/1/25, 6:10 AM

I'm trying to use Browser Rendering in my workflow but debug the code because:

I can't run browser rendering locally (need to use
```
--remote
```
```
--remote
```
)
I can't run workflows using using
```
--remote
```
```
--remote
```

Any good work around for this? I'm trying to avoid having multiple projects like pushing to a queue to have have Browser Rendering pick it up and process it. It feels like a perfect synergy for Workflows to work with Browser Rendering but the development lifecycle might be too painful at the moment to need to debug via deploying the code and using

console.log

console.log

s

C

crunchy•2/1/25, 10:46 PM

By the way, workflows do not trigger for me locallly (dev) when created by worker. Works in prod. wrangler 3.107.2

Hey there! Is there any possibility of running some of the steps of a workflow in parallel? For exam

Similar Threads