Why dont have any thing A100 or H100 now :(.
I don't understand,, I have reserved about 7 H100 but currently all H100 or A100 worldwide on runpod I don't see which one :(.
Intermittent timeouts on requests
I have a custom docker image serverless endpoint. I am sending a payload with the python package endpoint.run_sync(payload, timeout=60). I currently have 0 active workers.
I can typically send the first request. After completion, if I send a following request before that worker times out, it will often timeout without ever logging that the main function started. Basically, it seems like the message never gets in the RunPod Queue. What could be causing this behavior? How can I avoid it (or debug it)?
Logs are attached - this case is 2 successful requests, then a third request just times out - it seems like the request never gets to the queue (no logs)....
Logs are attached - this case is 2 successful requests, then a third request just times out - it seems like the request never gets to the queue (no logs)....
GPU Availability Issue on RunPod – Need Assistance
Hi everyone,
I’m currently facing an issue with GPU availability for my ComfyUI endpoint (id: kw9mnv7sw8wecj) on RunPod. When trying to configure the worker, all GPU options show as “Unavailable”, including 16GB, 24GB, 48GB, and 80GB configurations (as shown in the attached screenshot).
This is significantly impacting my workflow and the ability to deliver results to my clients since I rely on timely image generation....
