I might be able to even swap out Temporal for Cloudflare Workflows 😮

D

DmitryOP•10/24/24, 10:52 PM

I'm sure this has already been reported.. but seeing some weird flashing in terms to statuses?

D

DmitryOP•10/24/24, 10:52 PM

Like it flashes from Completed to Errored?

D

DmitryOP•10/24/24, 10:53 PM

Look's like it flashes when it's "Updating" ?

D

DmitryOP•10/24/24, 10:56 PM

F

fry69•10/24/24, 10:57 PM

There might be some rough edges indeed -> workflows

D

DmitryOP•10/24/24, 10:59 PM

Hmm interesting

Feel like that would have been something someone would have noticed with months of testing

D

DmitryOP•10/24/24, 10:59 PM

Will keep reporting the bugs as I see them

D

DmitryOP•10/24/24, 11:06 PM

Even though my wall time says 5s 123ms (at the top).. I'm only getting charged the 2 wall times for when my function ran correct (26ms and 24ms respectively)? Shouldn't the "Wall Time" at the top right there say 26ms+24ms instead of 5s 123ms?

D

DmitryOP•10/24/24, 11:06 PM

Cause wall time is what we're being charged correct?

D

DmitryOP•10/24/24, 11:06 PM

I'm not being charged for 5s 123ms of wall time here?

DDmitry I'm not being charged for 5s 123ms of wall time here?

F

fry69•10/24/24, 11:07 PM

As far as I know Cloudflare never charges for wall time, only for CPU time

DDmitry Cause wall time is what we're being charged correct?

M

Matt Silverlock•10/24/24, 11:26 PM

CPU time only. Covered in the docs and the blog post:

Cloudflare Docs

Pricing | Cloudflare Workflows docs

Workflows pricing is identical to Workers Standard pricing and are billed on two dimensions:

The Cloudflare Blog

Build durable applications on Cloudflare Workers: you write the Wor...

Cloudflare Workflows is now in open beta! Workflows allows you to build reliable, repeatable, long-lived multi-step applications that can automatically retry, persist state, and scale out. Read on to learn how Workflows works, how we built it on top of Durable Objects, and how you can deploy your first Workflows application.

MMatt Silverlock CPU time only. Covered in the docs and the blog post: * https://developers.cloud...

D

DmitryOP•10/24/24, 11:27 PM

Gotcha I thought Wall Time = CPU Time

D

DmitryOP•10/24/24, 11:27 PM

Makes more sense now thanks!

D

dave•10/25/24, 1:16 AM

Any technical downside to using custom IDs instead of the randomly generated ones?

E

Elliot Hesp•10/25/24, 6:29 AM

What are the memory constraints inside of a workflow? E.g download a big file, then do some processing in the next step

EElliot Hesp What are the memory constraints inside of a workflow? E.g download a big file, t...

F

fry69•10/25/24, 6:32 AM

-> https://developers.cloudflare.com/workflows/reference/limits/

D

dragonli•10/25/24, 6:46 AM

What is the maximum size of a workflow request body?

Ddragonli What is the maximum size of a workflow request body?

S

Seekerdasbatatas•10/25/24, 7:03 AM

If you mean the workflow instance payload ~1MiB

SSeekerdasbatatas If you mean the workflow instance payload ~1MiB

A

Advany•10/25/24, 7:41 AM

A way around that would be to save it to r2/kv and then use in the next step?

AAdvany A way around that would be to save it to r2/kv and then use in the next step?

S

Seekerdasbatatas•10/25/24, 8:11 AM

Exactly, I had an idea to make an abstraction on top of workflows to save every step to R2 and lazily load steps as you actually need them, we don't do it by default because it kind of defeats the purpose of the free tier

Cool side project for someone

as I don't have that much time to do it haahhaha

SSeekerdasbatatas If you mean the workflow instance payload ~1MiB

D

dragonli•10/25/24, 8:36 AM

ok

SSeekerdasbatatas If you mean the workflow instance payload ~1MiB

D

DoggeSlapper•10/25/24, 8:47 AM

is there a simple way to let's say deploy hono into multiple workers?

D

DoggeSlapper•10/25/24, 8:47 AM

rn my build is quite small about 40kb but not sure how big things will get

D

DoggeSlapper•10/25/24, 8:48 AM

but well on paid plan there is bigger limit right?

SSeekerdasbatatas Exactly, I had an idea to make an abstraction on top of workflows to save every ...

A

Advany•10/25/24, 9:05 AM

looping at the code, you would not be able to emake an abstraction right. Because RPC is the only way to save it outside the step... So it would be creating something inside the step to 'save to r2' and 'get from r2'. It wouldn't be easier that just using the binding haha. Or am I missing something?

Ddave Any technical downside to using custom IDs instead of the randomly generated one...

M

Matt Silverlock•10/25/24, 9:31 AM

None.

L

LordSilver•10/25/24, 10:37 AM

Isn't this an oxymoron?

L

LordSilver•10/25/24, 10:37 AM

So you pay for CPU time, but you don't pay for Subrequests.

L

LordSilver•10/25/24, 10:39 AM

So if in my workflow I use fetch to get data from a website and that request takes 3s, I'm billed for that 3s of CPU time, so it's like I paid for the subrequest.

LLordSilver So if in my workflow I use fetch to get data from a website and that request tak...

F

fry69•10/25/24, 10:39 AM

Wall time (e.g. awaiting a fetch request) is not CPU time.

L

LordSilver•10/25/24, 10:40 AM

I guess that's a Cloudflare thing then, because your Worker would still be active while waiting

LLordSilver I guess that's a Cloudflare thing then, because your Worker would still be activ...

F

fry69•10/25/24, 10:41 AM

Yes, but in a sleeping state and not eating billable CPU cycles.

M

MissS•10/25/24, 10:42 AM

Does anyone know how invocation count works with workflows? Does a retry count as a new invocation? Are each step a seperate invocation?

Is a three step workflow that succeeds on the first try, three invocations (because there are three steps), or just a single invocation?

MMissS Does anyone know how invocation count works with workflows? Does a retry count a...

F

fry69•10/25/24, 10:48 AM

From how I read the documentation each workflow is a single invocation and steps do not count as another invocation.

F

fry69•10/25/24, 10:48 AM

But I'd love to hear this confirmed.

F

fry69•10/25/24, 10:49 AM

(This should also be easily testable, just watch how the daily worker count changes on a free account)

M

MissS•10/25/24, 10:50 AM

Oh also, is there a way to limit concurrency of a specific workflow?

Let's say, downstream api is 100 req/min, I'd want to prioritize the oldest workflows and also limit concurrency. How would this look like with workflows?

MMissS Oh also, is there a way to limit concurrency of a specific workflow? Let's say,...

F

fry69•10/25/24, 10:51 AM

I do not think you have control over that part.

F

fry69•10/25/24, 10:51 AM

Unless you do some fancy self-organizing inside the workflow, maybe?

DDmitry I might be able to even swap out Temporal for Cloudflare Workflows 😮

D

Diogo Ferreira•10/25/24, 11:01 AM

Already identified issue @Dmitry . Nevertheless, thank you for reporting!

Ffry69 Unless you do some fancy self-organizing inside the workflow, maybe?

M

MissS•10/25/24, 11:07 AM

You can start a workflow from a queue, and you can limit the consumer concurrency from a queue, so I imagine you can limit the throughput of your workflow like this somehow but the DX probably isn't great

D

DanGamble•10/25/24, 11:36 AM

Are you able to currently export multiple workflows?

This seems to work

[[workflows]]
name = "anya-hindmarch-swatch-import"
binding = "SWATCH_IMPORT"
class_name = "SwatchImport"

[[workflows]]
name = "anya-hindmarch-swatch-import"
binding = "SWATCH_IMPORT"
class_name = "SwatchImport"

[[workflows]]
name = "anya-hindmarch-swatch-import"
binding = "SWATCH_IMPORT"
class_name = "SwatchImport"

[[workflows]]
name = "anya-hindmarch-swatch-import"
binding = "SWATCH_IMPORT"
class_name = "SwatchImport"

But this doesn't:

[[workflows]]
name = "anya-hindmarch-swatch-import"
binding = "SWATCH_IMPORT"
class_name = "SwatchImport"

[[workflows]]
name = "anya-hindmarch-foil-import"
binding = "FOIL_IMPORT"
class_name = "FoilImport"

[[workflows]]
name = "anya-hindmarch-swatch-import"
binding = "SWATCH_IMPORT"
class_name = "SwatchImport"

[[workflows]]
name = "anya-hindmarch-foil-import"
binding = "FOIL_IMPORT"
class_name = "FoilImport"

[[workflows]]
name = "anya-hindmarch-swatch-import"
binding = "SWATCH_IMPORT"
class_name = "SwatchImport"

[[workflows]]
name = "anya-hindmarch-foil-import"
binding = "FOIL_IMPORT"
class_name = "FoilImport"

[[workflows]]
name = "anya-hindmarch-swatch-import"
binding = "SWATCH_IMPORT"
class_name = "SwatchImport"

[[workflows]]
name = "anya-hindmarch-foil-import"
binding = "FOIL_IMPORT"
class_name = "FoilImport"

I proceed to get the attached error and then the

.log

.log

.log

.log gives me no help outside of saying it requires a

.env

.env

. I have

.dev.vars

.dev.vars

. If I copy these to

.env

.env

as well I get no additional errors at all in the log but it still crashes with the same message as the first screenshot

DDanGamble Are you able to currently export multiple workflows? This seems to work ``` [[w...

D

Diogo Ferreira•10/25/24, 11:42 AM

Thank you reporting it @DanGamble let us take a look at it

DDiogo Ferreira Thank you reporting it @DanGamble let us take a look at it

D

DanGamble•10/25/24, 11:43 AM

I was hoping to have ~10/15 or so. I can try and bundle them all into 1 for now as they are quite throwaway

DDanGamble Are you able to currently export multiple workflows? This seems to work ``` [[w...

M

Matt Silverlock•10/25/24, 12:02 PM

You can, yes. This looks like a local dev specific bug (which we can fix). This works:

export class FirstWorkflow extends WorkflowEntrypoint<Env, Params> {
    async run(event: WorkflowEvent<Params>, step: WorkflowStep) {
        const files = await step.do('my first step', async () => {
            return {
                inputParams: event,
                files: [],
            };
        });

        const apiResponse = await step.do('some other step', async () => {
            let resp = await fetch('https://api.cloudflare.com/client/v4/ips');
            return await resp.json<any>();
        });
    }
}

export class SecondWorkflow extends WorkflowEntrypoint<Env, Params> {
    async run(event: WorkflowEvent<Params>, step: WorkflowStep) {
        const files = await step.do('some step', async () => {
            return {};
        });

export class FirstWorkflow extends WorkflowEntrypoint<Env, Params> {
    async run(event: WorkflowEvent<Params>, step: WorkflowStep) {
        const files = await step.do('my first step', async () => {
            return {
                inputParams: event,
                files: [],
            };
        });

        const apiResponse = await step.do('some other step', async () => {
            let resp = await fetch('https://api.cloudflare.com/client/v4/ips');
            return await resp.json<any>();
        });
    }
}

export class SecondWorkflow extends WorkflowEntrypoint<Env, Params> {
    async run(event: WorkflowEvent<Params>, step: WorkflowStep) {
        const files = await step.do('some step', async () => {
            return {};
        });

export class FirstWorkflow extends WorkflowEntrypoint<Env, Params> {
    async run(event: WorkflowEvent<Params>, step: WorkflowStep) {
        const files = await step.do('my first step', async () => {
            return {
                inputParams: event,
                files: [],
            };
        });

        const apiResponse = await step.do('some other step', async () => {
            let resp = await fetch('https://api.cloudflare.com/client/v4/ips');
            return await resp.json<any>();
        });
    }
}

export class SecondWorkflow extends WorkflowEntrypoint<Env, Params> {
    async run(event: WorkflowEvent<Params>, step: WorkflowStep) {
        const files = await step.do('some step', async () => {
            return {};
        });

export class FirstWorkflow extends WorkflowEntrypoint<Env, Params> {
    async run(event: WorkflowEvent<Params>, step: WorkflowStep) {
        const files = await step.do('my first step', async () => {
            return {
                inputParams: event,
                files: [],
            };
        });

        const apiResponse = await step.do('some other step', async () => {
            let resp = await fetch('https://api.cloudflare.com/client/v4/ips');
            return await resp.json<any>();
        });
    }
}

export class SecondWorkflow extends WorkflowEntrypoint<Env, Params> {
    async run(event: WorkflowEvent<Params>, step: WorkflowStep) {
        const files = await step.do('some step', async () => {
            return {};
        });

[[workflows]]
name = "first-workflow"
binding = "FIRST_WORKFLOW"
class_name = "FirstWorkflow"

[[workflows]]
name = "second-workflow"
binding = "SECOND_WORKFLOW"
class_name = "SecondWorkflow"

[[workflows]]
name = "first-workflow"
binding = "FIRST_WORKFLOW"
class_name = "FirstWorkflow"

[[workflows]]
name = "second-workflow"
binding = "SECOND_WORKFLOW"
class_name = "SecondWorkflow"

[[workflows]]
name = "first-workflow"
binding = "FIRST_WORKFLOW"
class_name = "FirstWorkflow"

[[workflows]]
name = "second-workflow"
binding = "SECOND_WORKFLOW"
class_name = "SecondWorkflow"

[[workflows]]
name = "first-workflow"
binding = "FIRST_WORKFLOW"
class_name = "FirstWorkflow"

[[workflows]]
name = "second-workflow"
binding = "SECOND_WORKFLOW"
class_name = "SecondWorkflow"

➜  npx wrangler@latest deploy

Total Upload: 1.48 KiB / gzip: 0.62 KiB
Your worker has access to the following bindings:
- Workflows:
  - FIRST_WORKFLOW: FirstWorkflow
  - SECOND_WORKFLOW: SecondWorkflow
Uploaded two-workflows (1.76 sec)

➜  npx wrangler@latest deploy

Total Upload: 1.48 KiB / gzip: 0.62 KiB
Your worker has access to the following bindings:
- Workflows:
  - FIRST_WORKFLOW: FirstWorkflow
  - SECOND_WORKFLOW: SecondWorkflow
Uploaded two-workflows (1.76 sec)

➜  npx wrangler@latest deploy

Total Upload: 1.48 KiB / gzip: 0.62 KiB
Your worker has access to the following bindings:
- Workflows:
  - FIRST_WORKFLOW: FirstWorkflow
  - SECOND_WORKFLOW: SecondWorkflow
Uploaded two-workflows (1.76 sec)

➜  npx wrangler@latest deploy

Total Upload: 1.48 KiB / gzip: 0.62 KiB
Your worker has access to the following bindings:
- Workflows:
  - FIRST_WORKFLOW: FirstWorkflow
  - SECOND_WORKFLOW: SecondWorkflow
Uploaded two-workflows (1.76 sec)

Showing last 3 workflows:
┌───────────────────┬────────────────┬────────────────┬─────────────────────────┬─────────────────────────┐
│ Name              │ Script name    │ Class name     │ Created                 │ Modified                │
├───────────────────┼────────────────┼────────────────┼─────────────────────────┼─────────────────────────┤
│ first-workflow    │ two-workflows  │ FirstWorkflow  │ 10/25/2024, 12:01:24 PM │ 10/25/2024, 12:01:24 PM │
├───────────────────┼────────────────┼────────────────┼─────────────────────────┼─────────────────────────┤
│ second-workflow   │ two-workflows  │ SecondWorkflow │ 10/25/2024, 12:01:24 PM │ 10/25/2024, 12:01:24 PM │
├───────────────────┼────────────────┼────────────────┼─────────────────────────┼─────────────────────────┤
│ workflows-starter │ workflows-demo │ MyWorkflow     │ 10/23/2024, 11:33:58 AM │ 10/24/2024, 7:23:58 PM  │
└───────────────────┴────────────────┴────────────────┴─────────────────────────┴─────────────────────────┘

Showing last 3 workflows:
┌───────────────────┬────────────────┬────────────────┬─────────────────────────┬─────────────────────────┐
│ Name              │ Script name    │ Class name     │ Created                 │ Modified                │
├───────────────────┼────────────────┼────────────────┼─────────────────────────┼─────────────────────────┤
│ first-workflow    │ two-workflows  │ FirstWorkflow  │ 10/25/2024, 12:01:24 PM │ 10/25/2024, 12:01:24 PM │
├───────────────────┼────────────────┼────────────────┼─────────────────────────┼─────────────────────────┤
│ second-workflow   │ two-workflows  │ SecondWorkflow │ 10/25/2024, 12:01:24 PM │ 10/25/2024, 12:01:24 PM │
├───────────────────┼────────────────┼────────────────┼─────────────────────────┼─────────────────────────┤
│ workflows-starter │ workflows-demo │ MyWorkflow     │ 10/23/2024, 11:33:58 AM │ 10/24/2024, 7:23:58 PM  │
└───────────────────┴────────────────┴────────────────┴─────────────────────────┴─────────────────────────┘

Showing last 3 workflows:
┌───────────────────┬────────────────┬────────────────┬─────────────────────────┬─────────────────────────┐
│ Name              │ Script name    │ Class name     │ Created                 │ Modified                │
├───────────────────┼────────────────┼────────────────┼─────────────────────────┼─────────────────────────┤
│ first-workflow    │ two-workflows  │ FirstWorkflow  │ 10/25/2024, 12:01:24 PM │ 10/25/2024, 12:01:24 PM │
├───────────────────┼────────────────┼────────────────┼─────────────────────────┼─────────────────────────┤
│ second-workflow   │ two-workflows  │ SecondWorkflow │ 10/25/2024, 12:01:24 PM │ 10/25/2024, 12:01:24 PM │
├───────────────────┼────────────────┼────────────────┼─────────────────────────┼─────────────────────────┤
│ workflows-starter │ workflows-demo │ MyWorkflow     │ 10/23/2024, 11:33:58 AM │ 10/24/2024, 7:23:58 PM  │
└───────────────────┴────────────────┴────────────────┴─────────────────────────┴─────────────────────────┘

Showing last 3 workflows:
┌───────────────────┬────────────────┬────────────────┬─────────────────────────┬─────────────────────────┐
│ Name              │ Script name    │ Class name     │ Created                 │ Modified                │
├───────────────────┼────────────────┼────────────────┼─────────────────────────┼─────────────────────────┤
│ first-workflow    │ two-workflows  │ FirstWorkflow  │ 10/25/2024, 12:01:24 PM │ 10/25/2024, 12:01:24 PM │
├───────────────────┼────────────────┼────────────────┼─────────────────────────┼─────────────────────────┤
│ second-workflow   │ two-workflows  │ SecondWorkflow │ 10/25/2024, 12:01:24 PM │ 10/25/2024, 12:01:24 PM │
├───────────────────┼────────────────┼────────────────┼─────────────────────────┼─────────────────────────┤
│ workflows-starter │ workflows-demo │ MyWorkflow     │ 10/23/2024, 11:33:58 AM │ 10/24/2024, 7:23:58 PM  │
└───────────────────┴────────────────┴────────────────┴─────────────────────────┴─────────────────────────┘

MMatt Silverlock You can, yes. This looks like a local dev specific bug (which we can fix). This ...

D

DanGamble•10/25/24, 12:53 PM

Do you mean this works specifically in production or the

@latest

@latest

works with local dev too?

DDanGamble Do you mean this works specifically in production or the `@latest` works with lo...

D

Diogo Ferreira•10/25/24, 12:54 PM

It will work in production. The bug exists on local dev for the time being

DDanGamble Do you mean this works specifically in production or the `@latest` works with lo...

D

DanGamble•10/25/24, 12:54 PM

Just saw this was

deploy

deploy

so assume it still foobars in local dev, thanks @elithrar. Will do 1 big workflow for now as I really only need this to run locally as it's for data migrations/fixtures

D

DanGamble•10/25/24, 1:13 PM

Can you have a step within a step or does it all need to be top level?

I might be able to even swap out Temporal for Cloudflare Workflows 😮

Similar Threads

Similar Threads

Similar Threads