After several days of working API without fails, it started to return the following error :"ComfyUI server (127.0.0.1:8188) not reachable after multiple retries.".
What can be wrong?
Also noticed that a lot of my workers are throttled recently. The region is EU-RO-1. Execution timeout in serverless is set to 1200.
And the following is set in the handler.py:
COMFY_API_AVAILABLE_MAX_RETRIES = 500
COMFY_API_AVAILABLE_INTERVAL_MS = 50
After assumption that this happens due to the lack of GPUs, I tried to swtich from 5090 to two 4090 GPUs and it was not running at all. It was just idle all the time, despite 3 queued requests waiting for more than 5 minutes.
Currently all my workers are throttled and the question is, how can i rely on the service that does not guarantee the aviability of the workers for my API? I had working API for a week and due to higher demand apparently I do not get any more GPUs that suit my usage.