idle time duration
Hi, i am running a comfyui script on serverless endpoint. I have set the idle timeout to 5 seconds but the first worker keeps running up to 7 minutes after the last request got executed. Could you explain why it's keeping running for such a long time? (ywzdlqxw0yg6ec)
5 Replies
Got the same issue
With serverless vLLM (i set the idle 1sec)
I got the anwser, it's certainly because you activated Active Workers.
It's 40% cheaper but run always
I didn’t set a active worker
Unknown User•2y ago
Message Not Public
Sign In & Join Server To View
yes all requests get completed - for example i have 4 workers - 3 get shut down after a couple of seconds but the last one runs for several minutes
Unknown User•2y ago
Message Not Public
Sign In & Join Server To View