Performance Problems/Config review
Hello,
I am reaching out as I anticipate enhanced performance from our Scylla + JanusGraph deployment and am seeking insights to optimize it. We have tested versions 0.6.3 and 1.0.0-20230918-091019.c39a12a.
We currently operate a concise setup on Kubernetes, consisting of three nodes. Each node is allocated 10 CPUs exclusively for our tests and 60GB of memory. Scylla and JanusGraph are deployed on the same nodes, and a fourth node runs a benchmark program to assess our configuration’s efficacy.
The benchmark program repetitively executes a specific query within a loop, performed 100,000 times, with the workload handled by an execution service operating with 128 threads. If every Vertex is inserted, we achieve approximately 4k/s, and with updates only, it's around 10k/s.
I am attaching our most recent configuration for your review and would greatly appreciate any insights or suggestions. We have conducted extensive trial-and-error testing, and the ops/s were not significantly lower even in a single Scylla + single JanusGraph configuration. This leads me to believe there may be a misconfiguration somewhere that is throttling the overall system.
I eagerly await your recommendations, hints, and tips and am hopeful for constructive feedback to optimize our deployment.
I am reaching out as I anticipate enhanced performance from our Scylla + JanusGraph deployment and am seeking insights to optimize it. We have tested versions 0.6.3 and 1.0.0-20230918-091019.c39a12a.
We currently operate a concise setup on Kubernetes, consisting of three nodes. Each node is allocated 10 CPUs exclusively for our tests and 60GB of memory. Scylla and JanusGraph are deployed on the same nodes, and a fourth node runs a benchmark program to assess our configuration’s efficacy.
The benchmark program repetitively executes a specific query within a loop, performed 100,000 times, with the workload handled by an execution service operating with 128 threads. If every Vertex is inserted, we achieve approximately 4k/s, and with updates only, it's around 10k/s.
I am attaching our most recent configuration for your review and would greatly appreciate any insights or suggestions. We have conducted extensive trial-and-error testing, and the ops/s were not significantly lower even in a single Scylla + single JanusGraph configuration. This leads me to believe there may be a misconfiguration somewhere that is throttling the overall system.
I eagerly await your recommendations, hints, and tips and am hopeful for constructive feedback to optimize our deployment.
message.txt7.13KB
