Serverless workers frequent switch to initializing / throttles
Been playing with Serverless workers for a couple weeks now and love it.
But since yesterday I noticed a huge uptick of workers not sticking to their idle state. Every couple jobs they either go back to Initializing or are throttled.
This never was the case for the weeks I was using serverless. Very rarely they would lose their state but currently its happening inbetween every couple jobs.
Is there any datacenter maintenance going on or are the H100's just super occupied currently?
My configuration:
- CUDA 12.8
- All locations (no network volume attached)
- 80GB Pro (H100)
But since yesterday I noticed a huge uptick of workers not sticking to their idle state. Every couple jobs they either go back to Initializing or are throttled.
This never was the case for the weeks I was using serverless. Very rarely they would lose their state but currently its happening inbetween every couple jobs.
Is there any datacenter maintenance going on or are the H100's just super occupied currently?
My configuration:
- CUDA 12.8
- All locations (no network volume attached)
- 80GB Pro (H100)
