GPU pod's performance is inconsistent

I am using a pod (RTX 4090 with 100GB network-volume) to generate image.
As expected, a task need around 5-6s to finish. sometime performance drop to 30s/task.
Can anyone explain what's going on to me? Thank you so much
Screenshot_from_2024-06-20_15-04-25.png
Screenshot_from_2024-06-20_15-04-12.png
Was this page helpful?