Job Dispatching Issue - Jobs Not Sent to Running Workers
CPU HeadPod running Gradio frontend for comfyui serverless backend. Serverless nodes starts with custom image, they run comfyui directly from NetworkDrive with NetworkDrive venv3.12.3
My settings are configured to have one worker per job. When I send two jobs in parallel from differnt PCs, the platform correctly scales to two running workers, but the job queue assigns both jobs to the same worker sequentially. The second worker remains running without receiving a job. Log on a second worker says that comfy and handler is ready.
Configuration:
Auto Scaling Type: Request Count
Request Count: 1
Max Workers: 2
Active Workers: 0
Please help!
1 Reply
upd: when switching to quee mode - this behaviour repeats only when 0 active current workers. So after coldstart first worker somehow block rest workers to receive the job.
If 2 fresh workers running before sending any jobs - jobs distributed equally