ajay1495
CDCloudflare Developers
•Created by ajay1495 on 3/19/2025 in #workflows
Right, we should have expected retry
Sorry - I know it's confusing. There's actually two issues at play here:
1. I noticed that an instance was in a RUNNING state for a long time (both the instance and its single step): about 1 day and 8 hours. See first screenshot (before terminating). The single step that was in the instance only had a single try inside of it that was RUNNING for that entire 1 day and 8 hours. This is counter to expectation.
What should have happened is: after 2 minutes in the single step, the system should have timed out that step, and retried it. You can see the retry policy there.
Instead, the step was stuck in that RUNNING state (along with the instance) for over 1 day.
My question is: do we know why the retry policy wasn't being applied here? Why didn't the system auto retry after 2 minutes and instead had the step running for 1 day 8 hours?
We have a polling process that needs to be online to detect events and this caused an outage for us. Having clarity here would greatly help us build confidence we can rely on CF workflows moving forward.
2. Then, I manually terminated instance (1 day and 8 hrs into the instance being started - see second screenshot). The instance status updated correctly to TERMINATED, but the steps were showing as RUNNING. This is less of an issue and sounds like it may have been addressed.
Thanks for taking the time, @Matt Silverlock !
15 replies
CDCloudflare Developers
•Created by ajay1495 on 3/19/2025 in #workflows
Right, we should have expected retry
@Matt Silverlock
15 replies
CDCloudflare Developers
•Created by ajay1495 on 3/19/2025 in #workflows
Right, we should have expected retry
It was stuck like that for about 1 day and 8 hours, until I manually terminated it.
15 replies
CDCloudflare Developers
•Created by ajay1495 on 3/19/2025 in #workflows
Right, we should have expected retry
15 replies
CDCloudflare Developers
•Created by ajay1495 on 3/19/2025 in #workflows
Right, we should have expected retry
@HardlyWorkin' appreciate any guidance here 🙂
15 replies
CDCloudflare Developers
•Created by ajay1495 on 3/19/2025 in #workflows
Right, we should have expected retry
@Matt Silverlock @Diogo Ferreira
15 replies
CDCloudflare Developers
•Created by ajay1495 on 3/19/2025 in #workflows
Right, we should have expected retry
@Matt Silverlock
15 replies
CDCloudflare Developers
•Created by ajay1495 on 3/19/2025 in #workflows
Right, we should have expected retry
Sorry for the delay. Account ID is: 470d4729e23e8936fd2a8f6569770873
15 replies
CDCloudflare Developers
•Created by ajay1495 on 3/19/2025 in #workflows
Right, we should have expected retry
@HardlyWorkin' @Matt Silverlock
Let me know if any guidance on this. We're hoping to rely on Cloudflare Workflows for a polling process, so this seemingly spurious error gives us pause.
Having some clarity here would help us greatly.
15 replies
CDCloudflare Developers
•Created by ajay1495 on 3/19/2025 in #workflows
Right, we should have expected retry
@Matt Silverlock For context here are the events from that run:
[
{
"datetime": "2025-03-16T06:37:31Z",
"eventType": "ATTEMPT_START",
"instanceId": "cb2f6bf4-b248-4d1f-9504-cec844eb75f3",
"stepCount": 1,
"stepName": "get client database connection",
"wallTime": 0,
"workflowName": "poll-database-workflow",
"wallTimeTillNextStep": 0
},
{
"datetime": "2025-03-16T06:37:31Z",
"eventType": "STEP_START",
"instanceId": "cb2f6bf4-b248-4d1f-9504-cec844eb75f3",
"stepCount": 1,
"stepName": "get client database connection",
"wallTime": 0,
"workflowName": "poll-database-workflow",
"wallTimeTillNextStep": 0
},
{
"datetime": "2025-03-16T06:37:31Z",
"eventType": "WORKFLOW_START",
"instanceId": "cb2f6bf4-b248-4d1f-9504-cec844eb75f3",
"stepCount": 0,
"stepName": "",
"wallTime": 0,
"workflowName": "poll-database-workflow",
"wallTimeTillNextStep": 1
},
{
"datetime": "2025-03-16T06:37:32Z",
"eventType": "STEP_SUCCESS",
"instanceId": "cb2f6bf4-b248-4d1f-9504-cec844eb75f3",
"stepCount": 1,
"stepName": "get client database connection",
"wallTime": 0,
"workflowName": "poll-database-workflow",
"wallTimeTillNextStep": 0
},
{
"datetime": "2025-03-16T06:37:32Z",
"eventType": "ATTEMPT_SUCCESS",
"instanceId": "cb2f6bf4-b248-4d1f-9504-cec844eb75f3",
"stepCount": 1,
"stepName": "get client database connection",
"wallTime": 0,
"workflowName": "poll-database-workflow",
"wallTimeTillNextStep": 0
}
]
15 replies