Timeout Error by Indexing a large amount of Data (hnsw)

Hi together,
We got a Vector Table with a large amount of Data and we tried to set a hnsw index on the embedding column via PostgreSQL. The problem here is, that we got a Timeout ERROR in the SQL editor. Do anybody got a solution for that problem?
We tried following steps:

increasing the query/statement timeout
set the index via procedure
setup a new table with the index and copy the data to the new table

vick•1/8/24, 6:33 PM

how did you increase the statement timeout? specifically what commands did you run?

Heisenbüser•1/9/24, 11:45 AM

hi vick, we used:

set statement_timeout = '1000000s';

and then restarted the project

vick•1/9/24, 5:13 PM

The setset command only affects the current session. If you're doing that over the web UI, it does not persist beyond that one command. Restarting the project will for certain lose that setting. To make it unlimited, set it to 0.

Try it using a local client like the

psql

psql

CLI or a UI like DBeaver. These make persistent session connections to which you can issue multiple commands and retain that setting when running the index. You may also want to bump the maintenance_work_memmaintenance_work_mem value so the index operation can use more RAM. The settings will not affect any other connections.

IcyOP•1/9/24, 6:27 PM

Thanks for your reply Vick, we will try it out later.

Timeout Error by Indexing a large amount of Data (hnsw)

Similar Threads

Similar Threads

Similar Threads