Serverless throttled
Hi! Since yesterday I can't run my serverless endpoint - I'm constantly being throttled or given unhealthy workers. Can we do something to make it work?
Solution
I believe I've spoken to all of you in a mixture of other threads and in the general channel - but sharing this for visibility:
Throughout this week we've been running emergency maintenance and the users most affected are those running serverless workloads with popular GPUs. Where we may have a surplus of a specific GPU, we have to delist the machines that host the GPUs (where it's up to 8 GPUs per machine) to perform work on them.
We are obligated to perform this maintenance across the fleet and only ask for your patience until it's done and we can disclose the reason.
Throughout this week we've been running emergency maintenance and the users most affected are those running serverless workloads with popular GPUs. Where we may have a surplus of a specific GPU, we have to delist the machines that host the GPUs (where it's up to 8 GPUs per machine) to perform work on them.
We are obligated to perform this maintenance across the fleet and only ask for your patience until it's done and we can disclose the reason.
