hey team - I have almost 500 workflows

hey team - I have almost 500 workflows stuck as running status ( without steps ) for almost 5 days
7 Replies
Marco Aleixo
Marco AleixoOP3mo ago
not even sure how/what debug here, I dont see any step
Marco Aleixo
Marco AleixoOP3mo ago
No description
Marco Aleixo
Marco AleixoOP3mo ago
and almost 500 workflows stuck as waiting I'm seeing a few of these failing with { "error": "Aborting engine: Grace period complete", "stack": "Error: Aborting engine: Grace period complete\n at async DocumentProcessingWorkflow.run (main.js:985524:7)", "fileId": "bf8ee597-7473-4f54-8e0a-7e35fd82ee83" }
Matt Silverlock
Matt Silverlock3mo ago
Can you share your account ID? Use /link
Marco Aleixo
Marco AleixoOP2mo ago
done just sharing that I'm mainly having issues with document-processing-production and page-processing-production heyy, any news on this one? still seeing 500 as waiting, 555 as running without steps. do I need to manually stop 1k workflows?! ohh you don't offer an endpoint to terminate workflows instances, right? i'm afraid of keeping these dangling instances and they hurt my performance/limits
avenceslau
avenceslau2mo ago
Sorry no news yet, but we haven't had a proper look yet, I will try to have a look tomorrow. To speed up debugging, could you tell me roughly what the workflow that has those 500 instances does?
Marco Aleixo
Marco AleixoOP2mo ago
thanks! mainly external HTTP calls, we do have a bunch of steps but mainly calling external APIs that does the heavy thing like calling LLMs, calling workers AI to generate embedding, markdown

Did you find this page helpful?