[URGENT] EU-RO region endpoint currently only processing one request at a time

We have a production endpoint running in the EU-RO region but despite us having 21 workers 'running', only one seems to be getting processed

This is causing delays and timeout errors from our requests. Can we get some help please?

ashley•2/22/24, 1:41 PM

Are your workers throttled?

jgOP•2/22/24, 1:41 PM

61 Throttled, 16 Running, 0 Idle

ashley•2/22/24, 1:41 PM

Also provide endpoint id so it can be investigated.

jgOP•2/22/24, 1:42 PM

1wfnup871iklus

ashley•2/22/24, 1:42 PM

How many requests in the queue?

jgOP•2/22/24, 1:42 PM

50 at the moment

jgOP•2/22/24, 1:42 PM

also shared in the screen shot

ashley•2/22/24, 1:43 PM

Oh sorry I missed the 2nd screenshot

jgOP•2/22/24, 1:43 PM

no worries thanks for the quick response

jgOP•2/22/24, 1:43 PM

it does seem like one instance is processing the requests

ashley•2/22/24, 1:43 PM

Is it using 24GB PRO GPU tier?

jgOP•2/22/24, 1:44 PM

yup

ashley•2/22/24, 1:44 PM

@flash-singh can you advise here?

jgOP•2/22/24, 1:44 PM

oh wait 24GB GPU

jgOP•2/22/24, 1:44 PM

not the pro

ashley•2/22/24, 1:47 PM

Too much demand for the normal 24GB GPU tier at the moment, I actually moved my endpoint to a different region because of this, all of my workers became throttled.