Serverless SD concurrent requests on multiple checkpoints
Hi,
Do you know if there is a way to handle concurrent SD predictions (even 10 is fine) on different checkpoint with different prompt?
For example I want to run 5 concurrent requests on checkpoint_1 and 5 on checkpoint_2, passing the checkpoint name in the request body.
Thank you
Do you know if there is a way to handle concurrent SD predictions (even 10 is fine) on different checkpoint with different prompt?
For example I want to run 5 concurrent requests on checkpoint_1 and 5 on checkpoint_2, passing the checkpoint name in the request body.
Thank you
