Create index with HNSW silently fails

I was trying to create vector embeddings index with HNSW via the SQL editor on a table with ~100.000 OpenAI embeddings. After running the

create index

create index

command, I was checking the progress: the

tuples_total

tuples_total

remained on zero as it's on building index step, with number of

tuples_done

tuples_done

increasing for a few seconds until it finished, but no index was created.

I understand that this might be an issue with memory usage, but what's the recommended way to debug this? Will adjusting the

ef_construction

ef_construction

help at all in this case?

I tried running the same command on a much smaller table and it worked.

Appreciate your help!

Supabase•3y ago•

1 reply

kevinang

Create index with HNSW silently fails

I was trying to create vector embeddings index with HNSW via the SQL editor on a table with ~100.000 OpenAI embeddings. After running the

create index

create index

command, I was checking the progress: the

tuples_total

tuples_total

remained on zero as it's on building index step, with number of

tuples_done

tuples_done

increasing for a few seconds until it finished, but no index was created.

I understand that this might be an issue with memory usage, but what's the recommended way to debug this? Will adjusting the

ef_construction

ef_construction

help at all in this case?

I tried running the same command on a much smaller table and it worked.

Appreciate your help!

Create index with HNSW silently fails

Similar Threads

Create index with HNSW silently fails

Similar Threads

Similar Threads

Similar Threads