8 Replies
It looks like we have a client side limitation of 1MB per query. (We may also have it on the server side)
Can you just modify your generator to keep the sizes a little below the 1MB (1000000 bytes) size?
yes will do, can I then create a script with reference to all 2000 insert tqls and one commit at the end or should I consider batching them?
What kind of script is this? One for typedb-console?
Either way, It should be fine. As long as a single insert is below 1MB you won't hit the empty transaction error.
yep for console
Should you consider batching them?
Only if you see issues with performance.
ok cool will try it, thanks alot!
Ah so you'll have a 2GB commit then.
Commit changes are buffered in memory, so that might be a bit on the larger side depending on how much memory the machine has. You can try it.
If you don't mind batching, it's always safer to do some batching.
ok 👍