I got time variation in serverless workers, I don't know but every worker used RTX 4090
Hey, My every worker in idle mod and still got time difference in the complete process.
8 Replies
Can you explain more?
I try to generate the same image in idle worker but I faced issue with time variation like some of worker take time less than 30sec but at the same time few of them are taking more than 40sec.
okay there is this technology called flashboot
i think thats what makes it faster
but for the first time you send request, it will be slower because it needs to load things
right but we can see requests send to other workers and that's also taking less time
I also enable flash boot
What do you mean, what are you assuming?
that seems normal
What things do you do on your worker's startup?
or before calling the handler
Oh I thought every worker used the same GPU and I got a time difference of about 15-20 seconds, and each time I check the worker id and see the performance
are they running the same job?
what are they running?
yes
i generate image from the prompt