simulate 100 users request, L7 balancer help
I'm trying to simulate 100 users request in parallel. I don't see any spikes in the resource usage but the server is timing out. Is there any special configuration I need to do, need help please.
73HAMn4YTAyDF2I3BBJDTA
this is the porject id, I'm testing the subdomain one.
12 Replies
Hi @minsomai , first it's possible to look at the l7 balancer logs here:
https://app.zerops.io/project/73HAMn4YTAyDF2I3BBJDTA/logging?serviceStackId=6T5sl4bER72ewHo9enAC7w&minimumSeverity=3
I looked at the logs for your application (nodejs) but there aren't any logs there. For better debugging, it might be good to see if the application is working correctly.
ok, so assumption is the server is crashing right?
In the case of Node.js, horizontal scaling across multiple containers (if the application supports it) can certainly help more than vertical scaling.
so more active containers with fewer resources?
It very much depends on how the application is written. You can't say that in general.
ok
Generally, Node.js is a single-threaded programme (unless you're using a process manager), so there's not much point in scaling to multiple CPUs. Instead, you need more processes, which more containers will provide.
But as I write, it very much depends on how the application itself is written.
If the application can expose some metrics, it's possible to collect them to get a better overview of what's happening in the application. Zerops has Prometheus integration
https://app.zerops.io/project/73HAMn4YTAyDF2I3BBJDTA/observability
but that requires support within the application itself.
It can then also be used as a central system for multiple projects. Unfortunately, we are still working on the documentation.
I also noticed you mentioned you're testing via a Zerops subdomain? Be careful there, the limits are set lower because it's a shared element for multiple users.
no, I'm testing from our custom domain(sub)
Finally, it's possible to start tuning Nginx parameters on the L7 balancer. But I'd only try that once it's certain the problem isn't the application itself.
https://app.zerops.io/project/73HAMn4YTAyDF2I3BBJDTA/routing
