Best way to dynamically load balance across hundreds of nodes?
As the title says, what is the best way/is it possible to use Cloudflare to load balance across hundreds of nodes dynamically.
For context, we are currently using ELB to balance across our nodes which auto scale, but it has caused us quite a significant amount of issues recently which leads me to my next question:
If it is possible can we set a limit to how many connections get sent to a single node? Recently ELB has completely nuked our system due to how aggressively it directs hundreds of thousands of connections to nodes causing them to run out of file descriptors, which causes a chain reaction.
Again if it's possible, can we dynamically assign and un-assign nodes to balance across (this is a auto-scaling system so nodes go up and down all the time)
For context, we are currently using ELB to balance across our nodes which auto scale, but it has caused us quite a significant amount of issues recently which leads me to my next question:
If it is possible can we set a limit to how many connections get sent to a single node? Recently ELB has completely nuked our system due to how aggressively it directs hundreds of thousands of connections to nodes causing them to run out of file descriptors, which causes a chain reaction.
Again if it's possible, can we dynamically assign and un-assign nodes to balance across (this is a auto-scaling system so nodes go up and down all the time)
