Neptune Local Development Access Methods
Question for the Neptune folks - I'm trying to cobble together ergonomic local access to our development cluster.
Here's what I've got that works:
- SSM session running via an EC2 bastion host, which makes the targeted cluster (using
AWS-StartPortForwardingSessionToRemoteHost) available at localhost:8182
- A mapping in /etc/hosts resolving <my_cluster_url> to localhost...Solution:
Ok, after a bit more tinkering, here's an implementation that doesn't require any outside-script configuration or tools, and doesn't require disabling SSL.
It requires an additional import
AiohttpTransport which is used to pass the server hostname to DriverRemoteConnection via transport_factory, solving the hostname mismatch failure issue that arises without it by passing the 'correct' host to the TLS handshake.
```python...Usage of single cardinality AWS Neptune
hey, i've been looking around and haven't been able to find much good documentation on this so figured i'd ask here. i'm trying to doing upsertion via the efficient merge commands for gremlin in AWS Neptune. i've got a couple properties on the edges but it seem that the single cardinality isn't supported with mergeE. specificially, something like options with onCreate and onMatch:
it's just weird cause it's been working for mergeV
is there a different syntax or a different way to do it for mergeE?...
option(onCreate, [(from):'v1', (to):'v2', 'property': single('value')])
option(onCreate, [(from):'v1', (to):'v2', 'property': single('value')])
Solution:
Edge properties can only be single cardinality. So there's no need to specify cardinality when specifying properties for mergeE. https://tinkerpop.apache.org/docs/3.6.1-SNAPSHOT/reference/#vertex-properties ...
Moreover, while an Edge can only have one property of key "name" (for example), a Vertex can have multiple "name" properties....
Gremlin comparison between one node's own properties
I'm trying to have a query that will compare one node's properties without necessarily having to assign an alias to the node and was wondering whether this is possible in gremlin? As an example, I'd like to something like:
g.V().hasLabel("person").where(__.values("age"), lt(__.values("dayofBirth")))
or
g.V().hasLabel("person").where(__.values("name"), neq(__.values("birthdayMonth"))) , but this doesn't seem to work in gremlin.
I know that something like this works instead:...Is there an ETA on Neptune returning full element data?
Currently, Neptune still behaves like configured with ReferenceElementStrategy, i.e. it only returns element ids and labels. I remember this was about to change...is this still true and is there an ETA ?
Gremlin Query timeout issue
My setup contains Janusgraph 1.0.0 with cassandra as a backend.
I am trying to create an edge between two vertices, where one of the vertex contains more than 450K edges.
But everytime the operation fails with Query Timeout error as shown below:...
Partition strategy with an anonymous graph traversal and aliasing
I'm trying to query for a path that contains vertices filtered by a query that compares two node's property values. I have applied a partition strategy to my main graph traversal source, and all the vertices/edges I've seeded into my gremlin server contain the partitionKey and value (through the partition strategy). I'm trying to query within this partition, but because I need to use an anonymous graph traversal as part of an And step in my query, I'm not sure if anonymous traversals in Gremlin inherit the partition strategy set by the original graph traversal source. When I try and run this query
`g.V().
HasLabel("Person").
As("a").
InE("Owns")....
Solution:
I'm not sure what's wrong there, but I'll point out a few things. I recast your query as though written against the modern graph which makes it easy to test. I used 3.7.3:
```
gremlin> g.V().as('a').both().as('b').
......1> and(select('a').values('age').as('left').
......2> select('b').values('age').as('right')....
MergeE with a conditional on the value being set
I'm trying to use MergeE to create an edge if it does not exist (based on the label and in/out nodes) and if it does exist I want to update a modified timestamp on the edge only if the incoming timestamp is greater than what is on the edge, so far I've got something like:
```
g.mergeE([
(T.label): 'RUNS',
(to): 'nodeID',...
Solution:
Hi @thorOdinson,
I can add some context which might be helpful here. The purpose of the "onMatch traversal" is not actually intended to directly modify the found edge. That traversal is meant to produce a map which defines any properties to be updated. In your case, you would want a traversal which produces
["modifiedTime" : 'Wed Mar 05 12:15:39 EST 2025'] if the timestamp needs to be updated, or produces an empty map [:] otherwise.
Your approach of directly modifying the edge certainly can work, but I would give a caveat that this is not how the mergeE step was intended to be used. One thing you are missing if you want to continue with this approach is that the "onMatch" traversal must still produce a map. The simplest fix is to return an empty map if you don't want mergeE to make any changes beyond what is already done by your "match traversal". This might look something like this:...Gremlin python trying to connect Neptune WS when is down
Im trying to capture and control the exception when the database is down with gremlin but instead the queries or writers wait to max time limit, in this case lambda timeout, to report a problem, someone know how to set a time limit when this happen to avoid to use all time of a lambda timeout to close the connection?
Gremlin python connection to Neptune via IAM and WS
Does anyone know how to connect gremlin-python with websocket and IAM authorization to AWS Neptune. Right now I'm just using Websocket but without Auth, so is there a way to implement it?
Solution:
Here are some examples I found from the Neptune documentation. https://docs.aws.amazon.com/neptune/latest/userguide/access-graph-gremlin-python.html and https://docs.aws.amazon.com/neptune/latest/userguide/lambda-functions-examples.html#lambda-functions-examples-python . Both seem to be using the boto library to do the signing.
cypher-gremlin-console-plugin with Tinkerpop 3.7.2
Have anyone managed to get the cypher-gremlin-console-plugin v1.0.4 or another version working with Tinkerpop 3.7.2 ?
The latest published version of the plugin seem to only work for Tinkerpop 3.4 which is pretty old.
The problem seems to be that in v3.7.2 some required classes were moved or refactored into different packages. Hence, the plugin throws ClassNotFound exceptions....
Solution:
Unfortunately there has been quite a few of breaking changes from TinkerPop 3.4 to 3.7, from packaging to language semantics, so it is very hard to say where the break is occurring or if it's caused by any singular change.
It could be worth reaching out to the developers of that tool? Though there is likely a lot of work needed....
Gremlin python MergeV update properties
I'm working with gremlin python 3.7.1 and AWS Neptune 1.3.2.1, and I'm trying to update vertex properties with MergeV().option(OnMatch, {...}), however the behavior isn't what I expect, it should be a=b but appears to be a=[c.b] where c is the old value. Someone knows how to implement correctly this behavior with MergeV?
Solution:
If I'm understanding your question correctly, I think what you are seeing is a result of Neptune defaulting to
set cardinality for properties. Essentially what that means, is if I start with a vertex with property("name", "Alice"), and I try to overwrite the property with property("name", "Bob") Neptune will instead add the new property to a set such that vertex.name = {"Alice", "Bob"}. I think this is what you are seeing this set cardinality behaviour when using MergeV().
If you want to use mergeV and enforce single cardinality for properties (overwrite existing values instead of appending), you can try a query like this:
```...How can I use a subquery to translate airport code DAL into icao airport code KDAL, w air-routes?
I've loaded the air-routes data set, and I've added an aircraft like so:
g.addV("aircraft").property("aircraftLocation", "DAL")
I want to write a query that reports the location of all my aircrafts like so: [tailNumber:N12345,aircraftLocationIcao:KDAL]
To accomplish this, I need to translate the IATA aircraft location "DAL" into the ICAO aircraft location "KDAL". So the .project() step is not straightforward....Solution:
Hi @danielcraig23, I might try to search for the the specific airports with the necessary iata->icao mapping instead of the "cross join then filter" approach. This is the traversal I came up with:
```
g.V().
hasLabel("aircraft").as("ac").
values("aircraftLocation").as("iata")....
Gremlin.net for .net 8
Hi all, when can we expect a Gremlin.net version targeting .net 8? Gremlin.net’s latest version v3.7.3 only supports .net 6 which is out of support.
Solution:
Hi @lijinv, could you expand on any issues you may be seeing when attempting to use Gremlin.net with .net 8? .net 8 should be fully supported as of v3.7.2, and we currently run all of our Gremlin.net testing in .net 8. https://issues.apache.org/jira/browse/TINKERPOP-3030.
If you have found any incompatibilities with v3.7.3 in .net 8, that should likely be considered a bug....
Trying to load air-routes.graphml yields no such file or directory
graph.io(graphml()).readGraph('~/Downloads/air-routes.graphml') yields ~/Downloads/air-routes.graphml (No such file or directory)
```~ % curl https://raw.githubusercontent.com/krlawrence/graph/refs/heads/master/sample-data/air-routes.graphml -o air-routes.graphml
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed...Solution:
Using master branch I was able to see the error you had when using an incorrect file path but then the console succeeded after I modified the file path to point to the file I downloaded from Kelvin's repository:
```
Connected to the target VM, address: '127.0.0.1:53213', transport: 'socket'
,,,/...
Neptune, Gremlin Java & Bindings
Hey,
I've got a bit of an issue that I'm trying to find a solution for regarding the use of bindings in Gremlin with Neptune.
As stated in the docs, they're not supported. What I'd like to get to is a workaround solution where I can locally apply bindings to a query, convert it to a string and submit it to Neptune with the bindings "applied".
...
Solution:
@G.V() - Gremlin IDE (Arthur) with a small modification, it's possible to change the existing translators in 3.x to replace variable placeholders for the values in the bindings. adding this override to
GroovyTranslator.DefaultTypeTranslator:
```
@Override
protected Script convertToScript(final Object object) {
if (object instanceof Bytecode.Binding) {...Hot reloading of SSL certificates in gremlin-server
👋🏻 Hey. I'm trying to understand how SSL/TLS certificates are handled in TinkerPop.
Based on this code (https://github.com/apache/tinkerpop/blob/9627b78bcf38a0faf6a94dcd8ae3b80390d837f7/gremlin-server/src/main/java/org/apache/tinkerpop/gremlin/server/AbstractChannelizer.java#L324-L354), keystore files (certificates) are loaded once, on Channelizer initialization.
This would mean that a Channel keeps using the same certificate for its lifespan and, assuming they are long-lived, I imagine this could be an issue if users want to refresh their certificates often.
...
Solution:
It might be worth taking a look at this solution someone created which uses scheduled file based change detection https://github.com/Hakky54/java-tutorials/blob/main/instant-server-ssl-reloading-with-netty/netty-server/README.md
I am not sure how to use mergeE and mergeV using gremlin_python
I am using janusgraph with cassandra for my project and I want to implement upsert functionality. For that I didn't find much resources, only this gist (https://gist.github.com/spmallette/5cd448f38d5dae832c67d890b576df31) . From that, I wrote certain code which does work. The code looks like this
```
For vertex/node
g.merge_v({T.id: node.id}).option(
Merge.on_create, {...
Gremlin-JavaScript Global Websocket
I’m just wondering if there is a reason the gremlin-JavaScript 3.7 branch does not pass options/headers to the globalThis.WebSocket if defined?
Solution:
How to dynamically add custom Steps at runtime?
I am maintaining a graph engine service that provides different products. I have found that some complex scenarios cannot get query results through native Steps. Special business logic operations are required to implement custom special syntax through business code. The current custom syntax is done through @GremlinDsl, which is generated at compile time and the code is written in my own service. I hope that this special syntax can be defined by the product itself and pushed to the specified dir...
Solution:
You can use Groovy for all manner of trickery (AST manipulation, basic metaprogramming APIs, etc), but I'd take care with depending on it given the security risks associated with it. TinkerPop has been slowly moving away from it, first with bytecode based requests and more currently with the Gremlin ANTLR grammar. There is a general consensus that the latter will ultimately replace groovy/bytecode going forward into the future. I'm not sure if any of that impacts your decisions on how to maintai...
Graph computer question
In some cases TinkerGraphComputer removes duplicates from input, is this a bug or a feature?
For example
gremlin> g.V(1,1).count()
==>2
gremlin> g.withComputer().V(1,1).count()...
Solution:
i'd say this is the bug:
i wonder when that got introduced..........
gremlin> g.V(1,1).count()
==>2
gremlin> g.V(1,1).count()
==>2