Topics

RunPod•6mo ago

when will the status endpoint for a serverless function return 429s?

(see title)

1 Reply

flash-singh•6mo ago

429 happens for the following - rate limit for requests per endpoint - too many requests in queue (limit is max workers * 500)

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

11KMembers

View on Discord

Want results from more Discord servers?

Add your server

More Posts

Issue with worker-vllm and multiple workersI'm using the previous version of the worker-vllm (https://github.com/runpod-workers/worker-vllm/tre ThrottledHey 🙂 Is there something I can do to prevent getting throttled? I see the availability for the GP 4minute Serverless (Server Not Ready) Constantly.Sometimes getting a serverless worker boot up, run for ~5mins with "2023-12-18T16:18:12.087432983Z {Cost calculation for serverlessif this is my request, then how much am i billed: ( suppose i'm using the 24gb GPU ) { "delayTime":