Our worker receives webhook events from Shopify and publishes them to a Confluent Kafka topic via REST. It works correctly most of the time, but intermittently fails at random intervals.
During these failures, we encounter errors such as 403, 500, 530, and occasionally: "Fetch timeout after 5000ms for topic xyz."
There doesn’t appear to be an issue with our code—the worker simply receives the webhook and forwards it to the Kafka topic. I’ve also included a few screenshots for reference.
Could you let me know if any worker configuration changes might help resolve this issue? If you need additional details, I’d be happy to provide them.