Load balancing to death?
I've been sitting and watching your serverless system. And it just doesn't make sense.
I have two workers assigned. Yet you decide I need "Extra" instances spun up.
My workers are sitting there idle... oh there's a request let's send that to the "extra" queue. not the pod sitting idle....
Oh that last picture that was with an "Extra" pod we can't use that again we need to scrap that and use another cold booting pod...
Oh your workers are still idle shit .. well we better put them to sleep!
Oh you wanna downsize to one worker??? Cool well we are going to throttle that and stop it taking requests .. cool?
I have two workers assigned. Yet you decide I need "Extra" instances spun up.
My workers are sitting there idle... oh there's a request let's send that to the "extra" queue. not the pod sitting idle....
Oh that last picture that was with an "Extra" pod we can't use that again we need to scrap that and use another cold booting pod...
Oh your workers are still idle shit .. well we better put them to sleep!
Oh you wanna downsize to one worker??? Cool well we are going to throttle that and stop it taking requests .. cool?
