Cloudflare Developers•11mo ago

or you can create another script/worker that just exports the workflow directly

Ddan I see this message: https://discord.com/channels/595317990191398933/129692370779...

Matt Silverlock•2/25/25, 11:32 AM

Not at the moment.

SSeekerdasbatatas or you can create another script/worker that just exports the workflow directly

ANBU•2/25/25, 12:21 PM

Sorry, I didn't get this one, it sounds simpler. How can this be achieved?

SSeekerdasbatatas hey AFAICT, OpenNext uses their own entrypoint shim to be able to interoperate w...

ANBU•2/25/25, 1:39 PM

Tried this by copying this file, exporting my workflow from there and changing main file in wrangler.jsonc
But still getting the same error
Is there anything else thats needed apart from this?

MMatt Silverlock Not at the moment.

dan•2/25/25, 4:28 PM

It'd be cool to see that at some point - it's a blocking feature for me to use this for my AI workflows

WILDE•2/25/25, 4:53 PM

Hi there! I am trying to replace some queues with workflows and I've realized that there is a known issue

Workflows does not support npx wrangler dev --remote.

Workflows does not support npx wrangler dev --remote.

I'd like to know if this is something that will be fixed in the future or will remain as it is. I have some workers that are connected to some external services such as clickhouse, upstash and some others. Build them locally with Docker for

yarn dev

yarn dev

to work will be crazy

ajay | dreamlit.ai•2/26/25, 1:37 AM

Hi, big fan of workflows, excited to start using it in our app.

Quick question, whenever Wrangler detects a change, it hot reloads the server, which kills any currently running workflows. Is there any way to either 1) keep them alive or 2) have some kind of startup script/hook that runs so we can run relaunch them ourselves?

DanGamble•2/26/25, 9:47 AM

abstract class BaseWorkflow extends WorkflowEntrypoint<Env, Params> {
  async run(event: WorkflowEvent<Params>, step: WorkflowStep) {
    const something = await step.do("do something", async () => {
      // ...
    })

    await this.execute(event, step)
  }

  abstract execute(event: WorkflowEvent<Params>, step: WorkflowStep): Promise<void>
}

class TestWorkflow extends BaseWorkflow {
  async execute(event: WorkflowEvent<Params>, step: WorkflowStep) {
    const something = await step.do("do something", async () => {
      // ...
    })
    
    await someStepsIWantToShare(event, step)
  }
}

async function someStepsIWantToShare (event: WorkflowEvent<Params>, step: WorkflowStep) {
  const anotherStep = await step.do("do something else", async () => {
    // ...
  })
}

abstract class BaseWorkflow extends WorkflowEntrypoint<Env, Params> {
  async run(event: WorkflowEvent<Params>, step: WorkflowStep) {
    const something = await step.do("do something", async () => {
      // ...
    })

    await this.execute(event, step)
  }

  abstract execute(event: WorkflowEvent<Params>, step: WorkflowStep): Promise<void>
}

class TestWorkflow extends BaseWorkflow {
  async execute(event: WorkflowEvent<Params>, step: WorkflowStep) {
    const something = await step.do("do something", async () => {
      // ...
    })
    
    await someStepsIWantToShare(event, step)
  }
}

async function someStepsIWantToShare (event: WorkflowEvent<Params>, step: WorkflowStep) {
  const anotherStep = await step.do("do something else", async () => {
    // ...
  })
}

Is this a valid way for work with Workflows?

Matt Silverlock•2/26/25, 7:41 PM

FYI: we've just raised the # of concurrent Workflows from ~100 to ~1000 (briefly) to (now) ~4,500 per Workflow definition: https://x.com/chatsidhartha/status/1894834426552459433

(Plans are to get to near ~10k or more per Workflow as we move forward)

Sid (@chatsidhartha) on X

Yesterday, we shipped an (minor) increase in concurrency limits for @CloudflareDev Workflows to 1,500 (from 100)

Today, we shipped a major improvement and concurrency limits are now up (AGAIN) to 4,500!

Happy building

https://t.co/kKXv4nPVtl

•

2/26/25, 7:38 PM

ajay | dreamlit.ai•2/26/25, 8:39 PM

What happens when there's an active workflow running and there's a new version deployed? My understanding is that it will continue to run on the older version... but what if it invokes another workflow via its service bindings? Will that run in the old version or the new?

Aajay | dreamlit.ai What happens when there's an active workflow running and there's a new version d...

Matt Silverlock•2/26/25, 9:15 PM

Any running Workflow runs as-is today. Looking at options to provide config for this (e.g. terminate/restart all old instances on a deploy).

If it invokes another Workflow via a binding, that is still going to be the "latest" version. The old script isn't kept around. Workflows is no different here - if Worker A calls Worker B over a Service Binding, and you re-deploy Worker B, Worker A will always (only) call the latest code.

rodrigo•2/26/25, 9:19 PM

Running into (what I believe) are some rate limit errors when scheduling a workflow. I count around ~80k requests but only around 10k got scheduled/queued. I believe this error is related:

Error: Durable Object is overloaded. Too many requests queued.

Error: Durable Object is overloaded. Too many requests queued.

What's the rate limit for scheduling workflows? The

Maximum number of queued instances

Maximum number of queued instances

looks like 100k per the docs

Rrichw Hi all. With workflows, what's the best practice for pausing for user input? Let...

DanB•2/26/25, 9:51 PM

Maybe have 2 separate workflows.
One for everything up to the email (including), and the other is triggered by the user responding to the email.

wf1 --> send email --> sleep (max_time_to_wait_for_user_to_respond) --> handle user not responding
wf2 --> cancel wf1 --> handle user email response

DanB•2/26/25, 10:09 PM

I run a workflow from a worker. The logs of the worker go to cloudflare logs. In the logs, I see an error line with a single word "run". This is happening on every execution of the workflow, and it is not coming from my code. The workflow itself runs correctly and completes all steps normally. Any clue?

DDanB I run a workflow from a worker. The logs of the worker go to cloudflare logs. In...

kchro3•2/26/25, 11:06 PM

i'm seeing this happening too, would love support / explanation on what these internal errors are

Nnoman yall, i'm trying to to use whisper to transcribe some audio as part of a workflo...

Matt Silverlock•2/26/25, 11:27 PM

How big is the file? You will likely need to stream it in / stream the response out as otherwise the file + transcription will have to remain buffered in memory, in full, the whole time.

Nnoman the `AI.run` method doesn't like receiving a `ReadableStream` for the audio, oth...

Isaac McFadyen•2/27/25, 12:56 AM

Unfortunately I don't believe you can stream using the AI binding, because internally it stringifies all inputs to JSON and that can't be streamed: https://github.com/cloudflare/workerd/blob/main/src/cloudflare/internal/ai-api.ts#L118

Rrodrigo Running into (what I believe) are some rate limit errors when scheduling a workf...

kchro3•2/27/25, 1:55 AM

hey, can we get support on this? seeing lots of failures with starting workflows from a worker

kchro3•2/27/25, 7:09 PM

the workflows dashboard is really slow to load... is this happening for anyone else?

kchro3•2/27/25, 7:22 PM

Seeing this error:

{
  "$workers": {
    "diagnosticsChannelEvents": [],
    "truncated": false,
    "event": {
      "rpcMethod": "run"
    },
    "scriptName": "...",
    "outcome": "exception",
    "eventType": "rpc",
    "entrypoint": "...",
    "scriptVersion": {
      "id": "..."
    },
    "executionModel": "stateless",
    "requestId": "...",
    "wallTimeMs": 30006,
    "cpuTimeMs": 0
  },
  "level": "error",
  "message": "run",
  "$metadata": {
    "now": "2025-02-27T19:19:13.214Z",
    "id": "...",
    "requestId": "...",
    "service": "...",
    "error": "run",
    "message": "run",
    "account": "...",
    "type": "cf-worker-event",
    "fingerprint": "...",
    "origin": "rpc"
  }

}

{
  "$workers": {
    "diagnosticsChannelEvents": [],
    "truncated": false,
    "event": {
      "rpcMethod": "run"
    },
    "scriptName": "...",
    "outcome": "exception",
    "eventType": "rpc",
    "entrypoint": "...",
    "scriptVersion": {
      "id": "..."
    },
    "executionModel": "stateless",
    "requestId": "...",
    "wallTimeMs": 30006,
    "cpuTimeMs": 0
  },
  "level": "error",
  "message": "run",
  "$metadata": {
    "now": "2025-02-27T19:19:13.214Z",
    "id": "...",
    "requestId": "...",
    "service": "...",
    "error": "run",
    "message": "run",
    "account": "...",
    "type": "cf-worker-event",
    "fingerprint": "...",
    "origin": "rpc"
  }

}

Can I get assistance with understanding what this means and where it's coming from?

Jikyu•2/27/25, 7:30 PM

Is there a way to stop new instances of a workflow from spawning through the dashboard / cli? I did something naughty and have created an infinite loop of workflows - basically each workflow would create another workflow, and they would resolve too fast for me to cancel it through the dashboard

kchro3•2/27/25, 7:45 PM

$ wrangler deploy --env stage

✘ [ERROR] A request to the Cloudflare API (/accounts/.../workflows/...-workflow-stage) failed.

workflows.api.error.internal_server [code: 10001]

seeing this issue now too...

Aslak Hellesoy•2/27/25, 11:58 PM

How do people test Cloudflare Workflows? I've created a little library that lets me do it more eaasily, but I wonder if there is another recommeded way to do it.

https://github.com/oselvar/noflare (sorry, the docs aren't that great yet - look at the example code if you're interested)

GitHub

GitHub - oselvar/noflare: Test helpers for Cloudflare Workers

Test helpers for Cloudflare Workers. Contribute to oselvar/noflare development by creating an account on GitHub.

kchro3•2/28/25, 1:41 AM

I dont think it’s supported by wrangler yet. I’ve had to hack around to get any vite tests to run at all.

I just put the logic in a different file that I can unit test, but I cant do integration tests or test workflows end to end.

Aslak Hellesoy•2/28/25, 7:54 AM

@kchro3 yeah I came to the same conclusion. Noflare lets me test workflows end to end, and it's been a huge help to us. Example: https://github.com/oselvar/noflare/blob/main/src/examples/CalculateCubeWorkflow.test.ts

GitHub

noflare/src/examples/CalculateCubeWorkflow.test.ts at main · oselva...

Test helpers for Cloudflare Workers. Contribute to oselvar/noflare development by creating an account on GitHub.

JJikyu Is there a way to stop new instances of a workflow from spawning through the das...

Matt Silverlock•2/28/25, 11:19 AM

Not yet. Maybe we need a

terminateAll

terminateAll

here, although I would suggest redeploying the code that is spawning them to at least stop the initial run. cc @Seekerdasbatatas

Kkchro3 I dont think it’s supported by wrangler yet. I’ve had to hack around to get any ...

SeekerdasbatatasOP•2/28/25, 11:22 AM

I have a PR to get

vitest-pool-workers

vitest-pool-workers

to not crash with Workflows: https://github.com/cloudflare/workers-sdk/pull/8208, hopefully gets merged really :soontm: - you should be able to do some e2e testing with this, but we have more utils to properly test steps in our roadmap.

MMatt Silverlock Not yet. Maybe we need a `terminateAll` here, although I would suggest redeployi...

Jikyu•2/28/25, 11:24 AM

I was able to catch one and cancel it, but will try that method next time

DanB•2/28/25, 5:15 PM

I have to run some migration process on ~2000 users. For each user I have to run a couple of requests and update some DB record.
The migration for each user is going to be a workflow.
My question is how should I loop through all users to execute the workflow?
Is it ok to run it from a worker? Can I start 2000 workflows from a single worker request, or is there some limit?
Or, should that loop be a workflow on its own? Read the list of users, then start a step for each user that is dynamically named after the userId?

Kkchro3 Seeing this error: ``` { "$workers": { "diagnosticsChannelEvents": [], ...

kchro3•2/28/25, 5:24 PM

still am looking for some help on this issue. we're seeing our worker fail when creating a workflow, and we're getting tons of logs for durable object is overloaded / failures that just say "run"

i think it may be a limitation on how fast you can trigger workflows, even if you are under the concurrent execution limit (4500) or if you are under the total queueable limit (100K)

Kkchro3 still am looking for some help on this issue. we're seeing our worker fail when ...

Matt Silverlock•3/1/25, 2:17 AM

Right now, yes. Still working through raw throughput improvements.

kchro3•3/1/25, 2:23 AM

ack, is there a rough QPS guideline for triggering workflows?

DanB•3/1/25, 7:32 PM

Hi @Matt - I think that cf internal errors should not leak to the workers logs. I took me a while to try and figure out what they mean, until I realized that there's nothing I could or should do about it. Moreover, it affects the error rate that I see in the log, potentially masking real errors that I have to be aware of.

DanB•3/1/25, 7:55 PM

If I have a workflow that is being called from a worker which is sending its logs to cf logs .
In the workflow code, I use console.log().
Where can I expect to see the workflow logs?

DDanB If I have a workflow that is being called from a worker which is sending its log...

Matt Silverlock•3/1/25, 8:23 PM

In the Worker’s logs.

Kkchro3 ack, is there a rough QPS guideline for triggering workflows?

Matt Silverlock•3/1/25, 8:26 PM

Ballpark 100-250/sec as a very conservative number. Creating Workflows is the biggest “cost” right now - once they are running it’s much easier to scale out. Still optimizing.

MMatt Silverlock Ballpark 100-250/sec as a very conservative number. Creating Workflows is the bi...

kchro3•3/1/25, 8:29 PM

Ok, that explains a lot! Thank you

fatwang2•3/2/25, 10:13 AM

Hey, everyone, I want to share my open-source repo, GitPush, which is an AI GitHub release tracker powered by workflows and workers AI and Email Routing: https://github.com/fatwang2/gitpush

GitHub

GitHub - fatwang2/gitpush: an AI Github Rlease Tracker Powered by C...

an AI Github Rlease Tracker Powered by Cloudflare. Contribute to fatwang2/gitpush development by creating an account on GitHub.

fatwang2•3/2/25, 10:15 AM

cloudflare full stack

usf•3/3/25, 3:34 PM

Hi, is there any Workflows downtime right now? i've been seeing a lot of 500 internal server errors today, the status page doesn't mention it.

Uusf Hi, is there any Workflows downtime right now? i've been seeing a lot of 500 int...

SeekerdasbatatasOP•3/3/25, 3:57 PM

not as far as I'm aware

, could you give me your account id so I can investigate further?

SSeekerdasbatatas not as far as I'm aware 😅 , could you give me your account id so I can investig...

usf•3/3/25, 3:58 PM

sure here's it

adbf3651ede24f0e60bc37f80673f51f

adbf3651ede24f0e60bc37f80673f51f

, Thanks!

abstract class BaseWorkflow extends WorkflowEntrypoint<Env, Params> { async run(event: WorkflowEvent<Params>, step: WorkflowStep) { const something = await step.do("do something", async () => { // ... }) await this.execute(event, step) } abstract execute(event: WorkflowEvent<Params>, step: WorkflowStep): Promise<void> } class TestWorkflow extends BaseWorkflow { async execute(event: WorkflowEvent<Params>, step: WorkflowStep) { const something = await step.do("do something", async () => { // ... }) await someStepsIWantToShare(event, step) } } async function someStepsIWantToShare (event: WorkflowEvent<Params>, step: WorkflowStep) { const anotherStep = await step.do("do something else", async () => { // ... }) }

{ "$workers": { "diagnosticsChannelEvents": [], "truncated": false, "event": { "rpcMethod": "run" }, "scriptName": "...", "outcome": "exception", "eventType": "rpc", "entrypoint": "...", "scriptVersion": { "id": "..." }, "executionModel": "stateless", "requestId": "...", "wallTimeMs": 30006, "cpuTimeMs": 0 }, "level": "error", "message": "run", "$metadata": { "now": "2025-02-27T19:19:13.214Z", "id": "...", "requestId": "...", "service": "...", "error": "run", "message": "run", "account": "...", "type": "cf-worker-event", "fingerprint": "...", "origin": "rpc" } }

or you can create another script/worker that just exports the workflow directly

Similar Threads

Similar Threads

Similar Threads