Unstable Serverless GPU performance (Mostly too slow)
Despite using the same specifications and Docker image, the 4090 GPU workers have become unstable.
ComfyUI image-generation tasks used to run at about 4–5 iterations per second, but since 28 June, they’ve been wildly inconsistent. Sometimes 1 iteration per second, and sometimes even 4 seconds per iteration.
I’ve tried terminating the faulty workers and restarting them, even with a fresh Docker image, but the issue persists.
How can I solve this? Any help?
ComfyUI image-generation tasks used to run at about 4–5 iterations per second, but since 28 June, they’ve been wildly inconsistent. Sometimes 1 iteration per second, and sometimes even 4 seconds per iteration.
I’ve tried terminating the faulty workers and restarting them, even with a fresh Docker image, but the issue persists.
How can I solve this? Any help?
