Workers and rate increasing
Hello everyone, can someone explain to me how the number of workers affects the increased consumption? Because, as I understood, even if there are 100 workers, it will not affect the cost of money, because the same capacities will be used. But it seems to me that I'm wrong, because it's strange?..
13 Replies
Lets say you have 5 workers running for a day straight. You can calculate your cost will be the hourly of the selected GPU Type * 24 (for 1 day) * 5 workers. A higher number of workers changes how much you're prepared to spend if we need to automatically scale you up times 5.
Unknown User•2w ago
Message Not Public
Sign In & Join Server To View
This is understandable, but if I have a situation where workers work several times a day, "rarely but effectively." I need them to generate images using Fooocus. I always have, for example, 100 images to generate. 5 workers can do it in an hour. 10 workers can do it in half an hour. But it will cost the same amount of money, right?
Unknown User•2w ago
Message Not Public
Sign In & Join Server To View
Well, thanks! I wonder why everyone doesn't take as many workers as possible if it's literally a free boost of speed
Unknown User•2w ago
Message Not Public
Sign In & Join Server To View
Sorry, I didnt understand?..
Unknown User•2w ago
Message Not Public
Sign In & Join Server To View
because if you get flooded with 1000 requests then you get Huge amount of workers and begin paying some ridiculous amount of money per second when ur users can just wait in a 20s queue and you'll pay a fraction of the price
So unless ur running some overcharged ridiculous specialized serivce then it really doesn't make sense to have as many workers as possible
Why? For example, we have 1000 requests and 1000 workers, and we have, for example, 1000$/sec. But if we have 500 workers, we will have 500$/sec, but we will have 2 sec, so you will pay the same 1000$. Am I missing something?
Cold starts
Depending on what ur running can take up a LOT of time
Hm, i understand. Well, it will be harder to count than i think...
Unknown User•2w ago
Message Not Public
Sign In & Join Server To View