Serverless Job distribution
I have a process that loads 1500 jobs.
I have 4 gpus with 4 running workers.
Why are a majority of the jobs being assinged to only 1 of the 4 GPUs?
4 Replies
Also my execution times are way off. These should be done in < 10 second but its taking close to an hour?
Sample:
Unknown User•4w ago
Message Not Public
Sign In & Join Server To View
You might want to reduce the concurrent amount requests per worker. And for scaling, try request count