A40 Throttled very regularly!
I have a serverless endpoint with 3GPU that is being fully throttled very regularly.
It is fully unusable for long minutes, see screenshot, request are being queued forever.
It has been the case yesterday and today, it's far too unreliable...
It is fully unusable for long minutes, see screenshot, request are being queued forever.
It has been the case yesterday and today, it's far too unreliable...
