trying to generate 4 images at the same time (using 4 L40) but it seems like it will only make 2 at

trying to generate 4 images at the same time (using 4 L40) but it seems like it will only make 2 at a time?

If I leave OverQueue=1 (default) then 2 will generate exactly the same time, and then the next 2.

If I set OverQueue=0 then it still takes about 40 seconds before the fourth image starts to generate, so ends up taking just as much time. Like the first photo will be finished before the fourth one starts.

Shouldn't all 4 photos just start generating at the same time?

If I ask to generate 8 images at the same time, all 4 GPU's will run from the start like it should though...

On Massedcompute.
Screenshot_2025-02-21_at_10.53.17.png
Was this page helpful?