I got time variation in serverless workers, I don't know but every worker used RTX 4090

Hey, My every worker in idle mod and still got time difference in the complete process.
8 Replies
Unknown User
Unknown User15mo ago
Message Not Public
Sign In & Join Server To View
reomen_Sukuna
reomen_SukunaOP15mo ago
I try to generate the same image in idle worker but I faced issue with time variation like some of worker take time less than 30sec but at the same time few of them are taking more than 40sec.
Unknown User
Unknown User15mo ago
Message Not Public
Sign In & Join Server To View
reomen_Sukuna
reomen_SukunaOP15mo ago
right but we can see requests send to other workers and that's also taking less time I also enable flash boot
Unknown User
Unknown User15mo ago
Message Not Public
Sign In & Join Server To View
reomen_Sukuna
reomen_SukunaOP15mo ago
Oh I thought every worker used the same GPU and I got a time difference of about 15-20 seconds, and each time I check the worker id and see the performance
Unknown User
Unknown User15mo ago
Message Not Public
Sign In & Join Server To View
reomen_Sukuna
reomen_SukunaOP15mo ago
yes i generate image from the prompt

Did you find this page helpful?