[URGENT] EU-RO region endpoint currently only processing one request at a time
We have a production endpoint running in the EU-RO region but despite us having 21 workers 'running', only one seems to be getting processed
This is causing delays and timeout errors from our requests. Can we get some help please?
18 Replies
Are your workers throttled?
61 Throttled, 16 Running, 0 Idle
Also provide endpoint id so it can be investigated.
1wfnup871iklus
How many requests in the queue?
50 at the moment
also shared in the screen shot
Oh sorry I missed the 2nd screenshot
no worries thanks for the quick response
it does seem like one instance is processing the requests
Is it using 24GB PRO GPU tier?
yup
@flash-singh can you advise here?
oh wait 24GB GPU
not the pro
Too much demand for the normal 24GB GPU tier at the moment, I actually moved my endpoint to a different region because of this, all of my workers became throttled.
running worker count keep decreasing
Yeah they are all probably getting throttled because the demand exceeds the supply
currently there are 12 in progress jobs at the moment.
it seems like our endpoint has recovered
https://discord.com/channels/912829806415085598/1210229810668765234
They just released some new changes 🔥 hopefully these will help an endpoint recover