anyone figured out what causes this error? We are still seeing this regularly on our logs but the co

Aalex (he/him)Found this https://developers.cloudflare.com/workflows/build/workers-api/#cross-...

M

Murder Chicken•3/14/25, 6:56 PM

Were you ever able to get this to work as-documented?

MMurder Chicken Because a workflow has a configuration in it's `toml` like this: ``` [[workflows...

F

flash716•3/14/25, 6:58 PM

Are these workflows in different Workers?

M

Murder Chicken•3/14/25, 6:58 PM

Yes.

M

Murder Chicken•3/14/25, 6:59 PM

The first worker is only invoked via scheduled handler but in workflow's last step, I need to kick off another workflow.

M

Murder Chicken•3/14/25, 7:02 PM

If I try and use cross-script calls like in the documentation...

WORKER A wrangler.toml

[[workflows]]
name = "workflow-a"
binding = "WORKFLOW_A"
class_name = "WorkflowA"

[[workflows]]
name = "workflow-b"
binding = "WORKFLOW_B"
class_name = "WorkflowB"
script_name = "workflow-b"

[[workflows]]
name = "workflow-a"
binding = "WORKFLOW_A"
class_name = "WorkflowA"

[[workflows]]
name = "workflow-b"
binding = "WORKFLOW_B"
class_name = "WorkflowB"
script_name = "workflow-b"

[[workflows]]
name = "workflow-a"
binding = "WORKFLOW_A"
class_name = "WorkflowA"

[[workflows]]
name = "workflow-b"
binding = "WORKFLOW_B"
class_name = "WorkflowB"
script_name = "workflow-b"

[[workflows]]
name = "workflow-a"
binding = "WORKFLOW_A"
class_name = "WorkflowA"

[[workflows]]
name = "workflow-b"
binding = "WORKFLOW_B"
class_name = "WorkflowB"
script_name = "workflow-b"

WORKER B wrangler.toml

[[workflows]]
name = "workflow-b"
binding = "WORKFLOW_B"
class_name = "WorkflowB"

[[workflows]]
name = "workflow-b"
binding = "WORKFLOW_B"
class_name = "WorkflowB"

I get the following error (like other users are reporting)...

✘ [ERROR] Worker "workflows:workflow-b"'s binding "USER_WORKFLOW" refers to a service "core:user:workflow-b", but no such service is defined.

✘ [ERROR] Worker "workflows:workflow-b"'s binding "USER_WORKFLOW" refers to a service "core:user:workflow-b", but no such service is defined.

It's worth noting that

USER_WORKFLOW

USER_WORKFLOW

is not a string that exists in my codebase, at all. NOTE: Found a reference to

USER_WORKFLOW

USER_WORKFLOW

in the

workers-sdk

workers-sdk

codebase: https://github.com/cloudflare/workers-sdk/blob/99f802591e65a84f509a03a4071030eb0c6c11ba/packages/miniflare/src/plugins/workflows/index.ts#L77

M

Murder Chicken•3/14/25, 7:04 PM

Both workflows work just fine if invoked on their own. It's when I try to configure one to be called from the other where I run into issues.

A

ajgeiss0702•3/15/25, 12:35 AM

is an option for limiting workflow concurrency on the roadmap? I would love to move a bunch of stuff over to workflows, but I don't want to overwhelm some small external apis i call, which is what I currently use queues for

K

kchro3•3/15/25, 6:54 PM

Hey folks, we continue to see error logs for our workflow that just say "run". if I filter by request ID, I can see that the workflow successfully executed other steps, so I don't know where the "run" error log is coming from.

Kkchro3 Hey folks, we continue to see error logs for our workflow that just say "run". i...

C

Chaika•3/15/25, 7:59 PM

it's just how the workflow invocations show

C

Chaika•3/15/25, 8:00 PM

https://discord.com/channels/595317990191398933/1303411588929294358/1303488051917492318

K

kchro3•3/15/25, 8:00 PM

Are they supposed to be shown as errors?

C

Chaika•3/15/25, 8:01 PM

They're not supposed to, the workflow team as in that msg wants to fix it, but they currently all do

Rrodrigo anyone figured out what causes this error? We are still seeing this regularly on...

C

Chaika•3/15/25, 8:03 PM

same as above ^, as said in the thread "for now I'd just look at the workflows page to see how your instances are doing."

K

Khafra•3/15/25, 11:55 PM

Hi, is it possible to set the retry steps after a workflow fails? For example one of my workflow steps calls a third party api where I don't know the ratelimits. I want to fail the step if I'm ratelimited, but then retry at a specific date (the api gives us this date if we're ratelimited).

I can think of some ideas like

for (const param of params) {
  while (true) {
    const response = await step.do('<random name>', { /* options to not retry */ }, ...)

    if (response.status === 429) {
      await step.sleep('ratelimit expires', Number(response.headers.get('X-RateLimit-Reset')) * 1000)
    } else {
      break
    }
  }
}

for (const param of params) {
  while (true) {
    const response = await step.do('<random name>', { /* options to not retry */ }, ...)

    if (response.status === 429) {
      await step.sleep('ratelimit expires', Number(response.headers.get('X-RateLimit-Reset')) * 1000)
    } else {
      break
    }
  }
}

for (const param of params) {
  while (true) {
    const response = await step.do('<random name>', { /* options to not retry */ }, ...)

    if (response.status === 429) {
      await step.sleep('ratelimit expires', Number(response.headers.get('X-RateLimit-Reset')) * 1000)
    } else {
      break
    }
  }
}

for (const param of params) {
  while (true) {
    const response = await step.do('<random name>', { /* options to not retry */ }, ...)

    if (response.status === 429) {
      await step.sleep('ratelimit expires', Number(response.headers.get('X-RateLimit-Reset')) * 1000)
    } else {
      break
    }
  }
}

but I'm wondering if there's anything better?

K

Khafra•3/16/25, 12:03 AM

maybe a DurableObject is better in this case

KKhafra Hi, is it possible to set the retry steps *after* a workflow fails? For example ...

M

Matt Silverlock•3/16/25, 12:55 AM

Call

step.sleep

step.sleep

within the step when you get a rate limiting error? with the argument as the future Date?

K

Khafra•3/16/25, 12:55 AM

it never even crossed my mind to have nested steps lol

K

Khafra•3/16/25, 12:59 AM

this changes everything

M

Matt Silverlock•3/16/25, 1:07 AM

Workflows: it's just code

A

ajay | dreamlit.ai•3/17/25, 2:30 PM

I have a workflow run that appears to be stuck in "RUNNING" state. Here's what the dashboard shows for the run.

Any idea on what might be up? As you can see there's both a timeout and retry for this step, both of which appear to be ignored.

Aajay | dreamlit.ai I have a workflow run that appears to be stuck in "RUNNING" state. Here's what t...

M

Matt Silverlock•3/17/25, 8:42 PM

Timeout is per step... with

total retries before it will terminally fail.

2 minute

2 minute

is not the total time for all retries.

Aajay | dreamlit.ai I have a workflow run that appears to be stuck in "RUNNING" state. Here's what t...

M

Matt Silverlock•3/17/25, 8:50 PM

And by "stuck" - have you attempted to call

.stop

.stop

on the instance? What error do you get (if any) when you call

terminate

terminate

in the dash?

MMatt Silverlock Timeout is per step... with `20160` total retries before it will terminally fail...

A

ajgeiss0702•3/17/25, 10:24 PM

wouldn't the dashboard show if there were other retries though? it looked like that one step's first try had been running for at least an hour based on that timestamp

T

Txantonnikole•3/18/25, 1:17 AM

MMurder Chicken Were you ever able to get this to work as-documented?

A

alex (he/him)•3/18/25, 6:37 AM

Yeah but only running the workers with the same command

wrangler -c ... -c ...

wrangler -c ... -c ...

locally

CChaika They're not supposed to, the workflow team as in that msg wants to fix it, but t...

K

kchro3•3/18/25, 4:15 PM

is it possible to handle these exceptions so that they don't flood our metrics dashboard?

A

Advany•3/19/25, 1:03 PM

I am looping over a json array. each step does some api calls and changes the item inside the json. But somehow the steps are overwriting each other sometimes and I loose progress from previous steps.

I get the json using a step and then create a loop to go over the array inside jte json and for each item I call the step again.

How can I prevent steps from overriding each other

AAdvany I am looping over a json array. each step does some api calls and changes the it...

H

Hello, I’m Allie!•3/19/25, 2:42 PM

What do the steps in the loop return?

MMatt Silverlock Timeout is per step... with `20160` total retries before it will terminally fail...

A

ajay | dreamlit.ai•3/19/25, 2:50 PM

Right, we should have expected retry functionality there correct? It appears that it was in that stuck in that

Running

Running

state. When I queried for the events for this instanceId via the GraphQL analytics API - there was only 1 ATTEMPT_START for that ID, I do not see that any retries were executed.

Even after I terminated the instance, while the workflow run changed the status to

Terminated

Terminated

, the step status still says

Running

Running

. See screenshot. Perhaps I've misconfigured something?

Thank you for your help!

HHello, I’m Allie!What do the steps in the loop return?

A

Advany•3/20/25, 12:29 PM

fixed it! I make the loop part of a bigger step and get and set base don that!

O

omar•3/20/25, 1:28 PM

I'm getting an error fetching a file from R2 within my workflow

[ERROR] Uncaught (in promise) DOMException

[ERROR] Uncaught (in promise) DOMException

  const file = await step.do("get file from R2", async () => {
    return this.env.STATEMENT_BUCKET.get(fileIdentifier)
  });

  const file = await step.do("get file from R2", async () => {
    return this.env.STATEMENT_BUCKET.get(fileIdentifier)
  });

  const file = await step.do("get file from R2", async () => {
    return this.env.STATEMENT_BUCKET.get(fileIdentifier)
  });

  const file = await step.do("get file from R2", async () => {
    return this.env.STATEMENT_BUCKET.get(fileIdentifier)
  });

Oomar I'm getting an error fetching a file from R2 within my workflow ```[ERROR] Uncau...

H

Hello, I’m Allie!•3/20/25, 1:34 PM

I’m guessing that’s probably because an R2 file is not serializable

J

JMPA•3/20/25, 9:17 PM

do you know where can i found a example code with impaiting working?

J

JMPA•3/20/25, 9:18 PM

thats will be easier...

SSeekerdasbatatas I have a PR to get `vitest-pool-workers` to not crash with Workflows: https://gi...

K

kchro3•3/21/25, 8:49 PM

any updates on this? the agents SDK is also exporting workflows for some reason and now my tests are breaking again

AAslak Hellesoy Has anyone managed to get logs from workflows? When a workflow step fails, there...

M

Marco Aleixo•3/22/25, 8:48 PM

hey Aslak, curious if you made progress with sentry integration - I'm working to add sentry in my workflows as well - and we already struggled to instrument Queues...

A

ajay | dreamlit.ai•3/24/25, 3:43 PM

@Marco Aleixo @Aslak Hellesoy spent many hours on getting stack traces to show up in Sentry. Here's what finally worked:

A

ajay | dreamlit.ai•3/24/25, 3:44 PM

Z

zhawtof•3/24/25, 8:27 PM

Creating a workflow that is iterating through a list with pagination. The pagination operation works with a

next_cursor

next_cursor

so that you know the next page to go and fetch. My question:

Can I capture the next_cursor in a let like below to reference in each subsequent step?

let next_cursor;
do {
  next_cursor = await step( ...call API and do stuff ...);
} while (next_cursor !== null)

let next_cursor;
do {
  next_cursor = await step( ...call API and do stuff ...);
} while (next_cursor !== null)

let next_cursor;
do {
  next_cursor = await step( ...call API and do stuff ...);
} while (next_cursor !== null)

let next_cursor;
do {
  next_cursor = await step( ...call API and do stuff ...);
} while (next_cursor !== null)

M

Matt Silverlock•3/25/25, 4:37 PM

FYI for those of you with longer-running Workflows: we've increased the maximum CPU limit for all Workers to 5 minutes (just change a couple of lines of config): https://developers.cloudflare.com/changelog/2025-03-25-higher-cpu-limits/

Cloudflare Docs

Run Workers for up to 5 minutes of CPU-time

MMatt Silverlock FYI for those of you with longer-running Workflows: we've increased the maximum ...

M

Matt Silverlock•3/25/25, 4:37 PM

B

Boragorn•3/25/25, 9:03 PM

hi,

I sent a batch of 5,000 workflow executions, and for some reason, many of them are stuck in a "QUEUED" state. No failures, no errors --just hanging there in that state

B

Boragorn•3/25/25, 9:05 PM

btw -- I have the workers paid plan

J

jordanfinners•3/26/25, 9:02 PM

Are workflows down?

J

jordanfinners•3/26/25, 9:02 PM

I've been getting internal errors since 8pm

M

Matt Silverlock•3/26/25, 9:39 PM

Seeing Workflows recover / complete as of a couple of minutes ago.

M

Matt Silverlock•3/26/25, 9:42 PM

Note: This impacted Workflows that made/make external requests. Workflows that only call bindings or otherwise don’t call out to the Internet were unaffected.

J

jordanfinners•3/26/25, 9:42 PM

Thank you so much for the quick response and resolution

B

Bryan Chen•3/27/25, 6:46 AM

Is it possible for workflow to wait for some events? One of the step needs to trigger an external api to do some work that may take up to few minutes. a webhook callback will be received once the task is completed along with the task result. So I want to have a step to make a request, and resume / continue the workflow after a response is received or eventually have it timeout. I was thinking about serialize the state to db and restore them on callback and figured I am about to reimplement half of the workflow's functionality.

anyone figured out what causes this error? We are still seeing this regularly on our logs but the co

Similar Threads