Incremental schema changes - Indices get stuck in 'Installed' state
Hi All, in our use-case the graph schema is changing over time and we have issues to incrementally add indices to the schema as we get error in the below scenario:
1. We create a graph with an initial schema and fill it with data.
2. We try adding a new index and cycling through the recommended steps in the documentation document here:
https://docs.janusgraph.org/schema/index-management/index-lifecycle/
(Installed -> Registered -> Enabled (through Reindex action).
3. Script execution times out while waiting for the index to become 'Registered'
The issue we face is instability in the index state transitions. Usually, we run into a problem where the graph gets stuck in the 'Installed' state. This behavior is flaky, as an index sometimes gets reindexed successfully, while an identical index might face an issue getting created in the future.
We use JanusGraph 1.0.0 with Cassandra 4.0.11 backend.
Below are code snippets we use to create the indices and cycle them through their states so that they are enabled. You might notice that the code is somewhat verbose, with repeated transaction commits and rollbacks. This is a result of experimentation and is what has currently brought us to a bit more of a stable state. However, we are also open to suggestions for improvement here as well :). Thank you in advance!
1. We create a graph with an initial schema and fill it with data.
2. We try adding a new index and cycling through the recommended steps in the documentation document here:
https://docs.janusgraph.org/schema/index-management/index-lifecycle/
(Installed -> Registered -> Enabled (through Reindex action).
3. Script execution times out while waiting for the index to become 'Registered'
The issue we face is instability in the index state transitions. Usually, we run into a problem where the graph gets stuck in the 'Installed' state. This behavior is flaky, as an index sometimes gets reindexed successfully, while an identical index might face an issue getting created in the future.
We use JanusGraph 1.0.0 with Cassandra 4.0.11 backend.
Below are code snippets we use to create the indices and cycle them through their states so that they are enabled. You might notice that the code is somewhat verbose, with repeated transaction commits and rollbacks. This is a result of experimentation and is what has currently brought us to a bit more of a stable state. However, we are also open to suggestions for improvement here as well :). Thank you in advance!
compositeIndex.groovy1.18KB
edgeIndex.groovy1.37KB
mixedIndex.groovy1.31KB
propertyIndex.groovy1.42KB
