6 replies

Entity Retry Limit Issue with Defective Workflow Execution

I have a cluster entity that calls a workflow. For a while, that workflow had a defect in it so it would fail. This would cause the entity to fail too.

I fixed the workflow execution to avoid this defect, but I still have the entity trying to execute this old failed workflows over and over again. Here are example logs:

INFO {"message":"📦 Starting Shopify product import job: sij_GvgNBreCKmTiBYfYYYPxM","logLevel":"INFO","timestamp":"2025-09-05T14:50:37.926Z","annotations":{"address":{"shardId":{"group":"default","id":135},"entityType":"ShopifyImportWorker","entityId":"sij_GvgNBreCKmTiBYfYYYPxM"},"runner":{"host":"10.0.8.220","port":34433},"module":"EntityManager"},"spans":{},"fiberId":"#51202"}

INFO {"message":"Defect in entity, restarting","logLevel":"ERROR","timestamp":"2025-09-05T14:50:34.874Z","cause":"TypeError: productMetafieldDefs.filter is not a function. (In 'productMetafieldDefs.filter((def) => !def.type.includes(\"metaobject_reference\"))', 'productMetafieldDefs.filter' is undefined) {\n [cause]: Error: {\"name\":\"TypeError\",\"message\":\"productMetafieldDefs.filter is not a function. (In 'productMetafieldDefs.filter((def) => !def.type.includes(\\\"metaobject_reference\\\"))', 'productMetafieldDefs.filter' is undefined)\"}\n}","annotations":{"address":{"shardId":{"group":"default","id":206},"entityType":"ShopifyImportWorker","entityId":"sij_UPrPxsBUD5VoxtFHcydEk"},"runner":{"host":"10.0.8.220","port":34433},"module":"EntityManager"},"spans":{},"fiberId":"#51200"}

INFO {"message":"📦 Starting Shopify product import job: sij_GvgNBreCKmTiBYfYYYPxM","logLevel":"INFO","timestamp":"2025-09-05T14:50:37.926Z","annotations":{"address":{"shardId":{"group":"default","id":135},"entityType":"ShopifyImportWorker","entityId":"sij_GvgNBreCKmTiBYfYYYPxM"},"runner":{"host":"10.0.8.220","port":34433},"module":"EntityManager"},"spans":{},"fiberId":"#51202"}

INFO {"message":"Defect in entity, restarting","logLevel":"ERROR","timestamp":"2025-09-05T14:50:34.874Z","cause":"TypeError: productMetafieldDefs.filter is not a function. (In 'productMetafieldDefs.filter((def) => !def.type.includes(\"metaobject_reference\"))', 'productMetafieldDefs.filter' is undefined) {\n [cause]: Error: {\"name\":\"TypeError\",\"message\":\"productMetafieldDefs.filter is not a function. (In 'productMetafieldDefs.filter((def) => !def.type.includes(\\\"metaobject_reference\\\"))', 'productMetafieldDefs.filter' is undefined)\"}\n}","annotations":{"address":{"shardId":{"group":"default","id":206},"entityType":"ShopifyImportWorker","entityId":"sij_UPrPxsBUD5VoxtFHcydEk"},"runner":{"host":"10.0.8.220","port":34433},"module":"EntityManager"},"spans":{},"fiberId":"#51200"}

INFO {"message":"📦 Starting Shopify product import job: sij_GvgNBreCKmTiBYfYYYPxM","logLevel":"INFO","timestamp":"2025-09-05T14:50:37.926Z","annotations":{"address":{"shardId":{"group":"default","id":135},"entityType":"ShopifyImportWorker","entityId":"sij_GvgNBreCKmTiBYfYYYPxM"},"runner":{"host":"10.0.8.220","port":34433},"module":"EntityManager"},"spans":{},"fiberId":"#51202"}

INFO {"message":"Defect in entity, restarting","logLevel":"ERROR","timestamp":"2025-09-05T14:50:34.874Z","cause":"TypeError: productMetafieldDefs.filter is not a function. (In 'productMetafieldDefs.filter((def) => !def.type.includes(\"metaobject_reference\"))', 'productMetafieldDefs.filter' is undefined) {\n [cause]: Error: {\"name\":\"TypeError\",\"message\":\"productMetafieldDefs.filter is not a function. (In 'productMetafieldDefs.filter((def) => !def.type.includes(\\\"metaobject_reference\\\"))', 'productMetafieldDefs.filter' is undefined)\"}\n}","annotations":{"address":{"shardId":{"group":"default","id":206},"entityType":"ShopifyImportWorker","entityId":"sij_UPrPxsBUD5VoxtFHcydEk"},"runner":{"host":"10.0.8.220","port":34433},"module":"EntityManager"},"spans":{},"fiberId":"#51200"}

INFO {"message":"📦 Starting Shopify product import job: sij_GvgNBreCKmTiBYfYYYPxM","logLevel":"INFO","timestamp":"2025-09-05T14:50:37.926Z","annotations":{"address":{"shardId":{"group":"default","id":135},"entityType":"ShopifyImportWorker","entityId":"sij_GvgNBreCKmTiBYfYYYPxM"},"runner":{"host":"10.0.8.220","port":34433},"module":"EntityManager"},"spans":{},"fiberId":"#51202"}

INFO {"message":"Defect in entity, restarting","logLevel":"ERROR","timestamp":"2025-09-05T14:50:34.874Z","cause":"TypeError: productMetafieldDefs.filter is not a function. (In 'productMetafieldDefs.filter((def) => !def.type.includes(\"metaobject_reference\"))', 'productMetafieldDefs.filter' is undefined) {\n [cause]: Error: {\"name\":\"TypeError\",\"message\":\"productMetafieldDefs.filter is not a function. (In 'productMetafieldDefs.filter((def) => !def.type.includes(\\\"metaobject_reference\\\"))', 'productMetafieldDefs.filter' is undefined)\"}\n}","annotations":{"address":{"shardId":{"group":"default","id":206},"entityType":"ShopifyImportWorker","entityId":"sij_UPrPxsBUD5VoxtFHcydEk"},"runner":{"host":"10.0.8.220","port":34433},"module":"EntityManager"},"spans":{},"fiberId":"#51200"}

This has been in an infinite loop for a day now, just logging this over and over. I think part of the problem is that the workflow results are cached so the entity just fails, but is there some way to set a limit on how many times a message gets retried in an entity when it hits a defect?

Entity Retry Limit Issue with Defective Workflow Execution

Similar Threads

Similar Threads

Similar Threads