Is dynamically setting a minimum worker viable?
Wondering about:
https://docs.runpod.io/docs/create-serverless-endpoint#modify-an-existing-serverless-endpoint
Let's say that I have 5 throttled worker, and I dynamically set a minimum worker to 1 or 2? Does it kick off throttled workers and honors the minimum workers?
Just been thinking about if I should be if I am experiencing heavier loads, be dynamically increasing the minimum workers active to guarantee processing time.
0 Replies