What version of wrangler are you using? How are you seeing that it is retrying the step? I can't r

MMatt Silverlock What version of wrangler are you using? How are you seeing that it is retrying t...

M

Matt SilverlockOP•1/15/25, 3:27 PM

Fails every time, as expected:

Ssmcstewart @Matt Thanks! It's certainly a wrangler dev issue.

M

Matt SilverlockOP•1/15/25, 3:46 PM

You mean - only local dev? What version of wrangler?

L

Luca (steebchen)•1/15/25, 6:59 PM

I have some feedback – it seems that in a step.do() not the full error message may be shown on the dashboard? it just says ZodError; I doubt it's an issue on zod's side?

await step.do("detect spam", async () => {
  return await detectSpam(this.env, opts.payload.message.content);
});

await step.do("detect spam", async () => {
  return await detectSpam(this.env, opts.payload.message.content);
});

await step.do("detect spam", async () => {
  return await detectSpam(this.env, opts.payload.message.content);
});

await step.do("detect spam", async () => {
  return await detectSpam(this.env, opts.payload.message.content);
});

check spam basically does this:

    const response = await ai(env).chat.completions.create({
        response_format: zodResponseFormat(schema, "spam_detection"),
        model: "gpt-4o",
        messages: [
            {
                role: "user",
                content: prompt,
            },
        ],
    });

    return schema.parse(JSON.parse(response.choices[0].message.content || "{}"));

    const response = await ai(env).chat.completions.create({
        response_format: zodResponseFormat(schema, "spam_detection"),
        model: "gpt-4o",
        messages: [
            {
                role: "user",
                content: prompt,
            },
        ],
    });

    return schema.parse(JSON.parse(response.choices[0].message.content || "{}"));

    const response = await ai(env).chat.completions.create({
        response_format: zodResponseFormat(schema, "spam_detection"),
        model: "gpt-4o",
        messages: [
            {
                role: "user",
                content: prompt,
            },
        ],
    });

    return schema.parse(JSON.parse(response.choices[0].message.content || "{}"));

    const response = await ai(env).chat.completions.create({
        response_format: zodResponseFormat(schema, "spam_detection"),
        model: "gpt-4o",
        messages: [
            {
                role: "user",
                content: prompt,
            },
        ],
    });

    return schema.parse(JSON.parse(response.choices[0].message.content || "{}"));

LLuca (steebchen)I have some feedback – it seems that in a step.do() not the full error message m...

M

Matt SilverlockOP•1/15/25, 7:31 PM

https://zod.dev/ERROR_HANDLING?id=formatting-errors

GitHub

TypeScript-first schema validation with static type inference

LLuca (steebchen)I have some feedback – it seems that in a step.do() not the full error message m...

M

Matt SilverlockOP•1/15/25, 7:31 PM

If you want to print the error reason, you should catch it and format the

ZodError

ZodError

ZodError

ZodError

MMatt Silverlock If you want to print the error reason, you should catch it and format the `ZodEr...

L

Luca (steebchen)•1/15/25, 7:43 PM

thanks a lot for the quick pointer. really appreciate it.

L

Luca (steebchen)•1/15/25, 7:51 PM

there is no error handler with workflows yet, is there? like inFailure with inngest https://www.inngest.com/docs/reference/functions/handling-failures

L

Luca (steebchen)•1/15/25, 7:52 PM

I'd like to catch any failures and send the details to sentry

D

D Trombett•1/15/25, 7:54 PM

iirc they suggested using a try catch

L

Luca (steebchen)•1/15/25, 8:23 PM

fair enough for the beta. would be great to have that though

D

D Trombett•1/15/25, 9:07 PM

Agree :plus1green:

L

Luca (steebchen)•1/15/25, 9:42 PM

@DaveMurphySF you can ignore these, see https://discord.com/channels/595317990191398933/1328145630341894224/1328473979190509669

R

Rakhim•1/16/25, 12:05 PM

I have a growing backlog of pending workflow instances, while there are only a dozen (not 100) currently executing ones. Anyone has this problem? Perhaps I'm doing something wrong or I misunderstood the limits?

RRakhim I have a growing backlog of pending workflow instances, while there are only a d...

M

Matt SilverlockOP•1/16/25, 12:59 PM

Can you share your account ID here? (it’s safe to share publicly)

MMatt Silverlock Can you share your account ID here? (it’s safe to share publicly)

R

Rakhim•1/16/25, 1:17 PM

1ac93aea0842f2d3ef10111b5bf7bb11

1ac93aea0842f2d3ef10111b5bf7bb11

1ac93aea0842f2d3ef10111b5bf7bb11

1ac93aea0842f2d3ef10111b5bf7bb11

K

kchro3•1/16/25, 11:02 PM

Hi team, can you clarify if "concurrent executions" means any incomplete workflow or if it means any concurrently running steps?

For example, if I have a workflow with delays of multiple days, would they be considered concurrent while they are sleeping?

Kkchro3 Hi team, can you clarify if "concurrent executions" means any incomplete workflo...

T

tadhglewis•1/17/25, 10:25 AM

No, it's only running instances. Sleeping ones aren't counted

M

Mr. Technician•1/17/25, 3:44 PM

can I call workflow steps in a loop?

MMr. Technician can I call workflow steps in a loop?

A

Ashley•1/17/25, 6:43 PM

Yup! It’s just vanilla JS/TS, so you can do loops/conditionals etc

AAshley Yup! It’s just vanilla JS/TS, so you can do loops/conditionals etc

M

Mr. Technician•1/17/25, 6:44 PM

great, I wanted to make sure that wouldn't upset anything in the step architecture

M

Mr. Technician•1/17/25, 6:45 PM

the only thing cloudflare workers is missing is support for puppeteer stealth plugins when using the browser rendering API

M

Mr. Technician•1/18/25, 5:09 PM

is this a reasonable way of making sure this variable remains accessible?

const maxFutureDays = await step.do(`get ${key} max days`, async () => 330);

const maxFutureDays = await step.do(`get ${key} max days`, async () => 330);

const maxFutureDays = await step.do(`get ${key} max days`, async () => 330);

const maxFutureDays = await step.do(`get ${key} max days`, async () => 330);

AAshley Yup! It’s just vanilla JS/TS, so you can do loops/conditionals etc

M

Mr. Technician•1/18/25, 5:12 PM

what I'm not clear on here is what happens if the engine restarts while my loop is running

M

Mr. Technician•1/18/25, 5:13 PM

for example I have a while loop that I will break out of depending on the result of the step called within it

M

Mr. Technician•1/18/25, 5:13 PM

I guess I am safe as long as all of my variables are step returns

M

Mr. Technician•1/18/25, 5:18 PM

also, I'm not sure my question was clear. I want to call steps within a loop, not use loops within a step

M

Mr. Technician•1/18/25, 5:18 PM

for example:

M

Mr. Technician•1/18/25, 5:19 PM

while (somecondition){
    await step.do(`some action `${somekey}`, async () => {});
}

while (somecondition){
    await step.do(`some action `${somekey}`, async () => {});
}

while (somecondition){
    await step.do(`some action `${somekey}`, async () => {});
}

while (somecondition){
    await step.do(`some action `${somekey}`, async () => {});
}

M

Mr. Technician•1/18/25, 5:19 PM

but this seems to violate: https://developers.cloudflare.com/workflows/build/rules-of-workflows/#name-steps-deterministically

Cloudflare Docs

Rules of Workflows · Cloudflare Workflows docs

A Workflow contains one or more steps. Each step is a self-contained, individually retriable component of a Workflow. Steps may emit (optional) state that allows a Workflow to persist and continue from that step, even if a Workflow fails due to a network or infrastructure issue.

M

Mr. Technician•1/18/25, 5:20 PM

the problem is my workflow isn't strictly deterministic, I need to check state in D1, then depending on the result from my upstream API I need to loop another step an unknown number of times

M

Mr. Technician•1/18/25, 5:21 PM

the documentation seems to discourage this

A

Ashley•1/18/25, 5:22 PM

It’s hard without knowing the underlying data, but the step name as you linked is the cache key. So as long as the data points you’re using are determinsticly named, it will just return from cache if that step name has a value. If you’re looping over results in D1, why not use the table’s primary key for example in the step name?

AAshley It’s hard without knowing the underlying data, but the step name as you linked i...

M

Mr. Technician•1/18/25, 5:27 PM

I can provide a little more context. I'm the developer of https://railforless.us/ which scrapes prices for Amtrak's trains. They use a bucket pricing system and I am working on a workflow that will find every current bucket (I know there are 8). I am scraping 14 days of prices per step, so I would loop until I have found all 8 buckets (or give up after x tries). It sounds like I could use the date range as the key and it would correctly cache the state of that step?

RailForLess.us

Taking the train shouldn't be a pain. Make your next Amtrak trip a reality with flexible scheduling and the tools you need to plan the perfect trip.

A

Ashley•1/18/25, 5:39 PM

Yes, I think so, as long as the date is consistent (e.g. not using “now” functions where the time changes etc so make sure it’s just YYYY-MM-DD or something)

M

Mr. Technician•1/18/25, 11:29 PM

it would be, yeah

MMatt Silverlock Can you share your account ID here? (it’s safe to share publicly)

R

Rakhim•1/19/25, 10:28 AM

any updates? I had to reduce the pace of creating new workflow instances in an attempt to reduce the backlog, it works but very slowly. I'm still never seeing anything close to 100 concurrent workflows

MMr. Technician I can provide a little more context. I'm the developer of https://railforless.us...

T

thousandmiles•1/20/25, 5:39 AM

great tool you built. so is your website purely serverless on cf right now?

Tthousandmiles great tool you built. so is your website purely serverless on cf right now?

M

Mr. Technician•1/20/25, 5:41 AM

thanks! My buddy takes credit for the interface while i handled all of the API pieces. But yes, it’s purely serverless on cf with the exception of our remote puppeteer service, since the browser rendering API in workers is missing features we need

M

Mr. Technician•1/20/25, 5:43 AM

i use websockets, durable objects, queues, d1, and cron jobs

M

Mr. Technician•1/20/25, 5:43 AM

and kv

MMr. Technician thanks! My buddy takes credit for the interface while i handled all of the API p...

T

thousandmiles•1/20/25, 5:45 AM

impressive! though i am not quite proficient on cf worker myself, but i did manage some heavy workload using aws lambda/step functions back in 2 years.

M

Mr. Technician•1/20/25, 5:46 AM

i originally wrote the backend in .net to run in azure functions, then rewrote it all in typescript to leverage workers

MMr. Technician i use websockets, durable objects, queues, d1, and cron jobs

T

thousandmiles•1/20/25, 5:47 AM

are you planning to opensource (even parts of) this backend as well?

MMr. Technician i originally wrote the backend in .net to run in azure functions, then rewrote i...

T

thousandmiles•1/20/25, 5:48 AM

way to go. this is exactly i am doing now, u know, think serverless. even LLM/agentic workflow is going serverless

M

Mr. Technician•1/20/25, 5:48 AM

possibly. the react front-end is open-source presently

M

Mr. Technician•1/20/25, 5:49 AM

i hope my “secret” is kept safe from amtrak who would probably rather this service didn’t exist

What version of wrangler are you using? How are you seeing that it is retrying the step? I can't r

Similar Threads