invalid input syntax for type bigint when importing vectors from CSV
Hello everyone is this the right place for asking for help?
I get this error when trying to follow the documentation for importing from CSV files. I have created all my embeddings and stored them in a CSV
This is a row in my csv
14 Replies
adverse-sapphire•2y ago
int8 is the same as bigint
So Postgres is trying to interpret you vector as an int8 (id column)
exotic-emeraldOP•2y ago
hmmm....oh i think i understand what is the problem....i wanted the id to be autogenerated.
so i needed to specify the columns
\copy embeddings(embedding,value) FROM 'src/assets/vector-sample.csv' DELIMITER ',' CSV HEADER
adverse-sapphire•2y ago
yes, that sounds right
exotic-emeraldOP•2y ago
this works
Thanks 🙂 I'm a bit rusty from SQL
adverse-sapphire•2y ago
glad you figured it out!
me too lol
exotic-emeraldOP•2y ago
jajaja xD
exotic-emeraldOP•2y ago
I get permission_denied whenever I try to create an embedding extension (rather than pg_vector) is pgembedding no longer supported? it seemed to be supported in July 2023 https://blog.langchain.dev/neon-x-langchainhnsw-in-postgres-with-pg_embedding/
LangChain Blog
Neon x LangChain: HNSW in Postgres with pg_embedding
Editor’s Note: This blog post was written in collaboration with the Neon team (Raouf Chebri in particular). The vectorstore space is on fire, and we’re excited to highlight new implementations and options. We’re also really excited by the detailed analysis done here, bringing some solid stats and
adverse-sapphire•2y ago
@Atahualpa pg_embedding can no longer be used by new customers
@Mahmoud or @Daniel do you guys know if we have any content about moving away from pg_embedding to pgvector?
deep-jade•2y ago
Hey, we do. You can find it here: https://neon.tech/docs/extensions/pg_embedding
Neon
The pg_embedding extension (Support Discontinued) - Neon Docs
As of Sept 29, 2023, Neon is no longer committing to pg_embedding. Support will remain in place for existing users of the extension, but we strongly encourage migrating to pgvector. For migration inst...
exotic-emeraldOP•2y ago
oh i see... that's sad to hear. I was really hoping to use HNSW
adverse-sapphire•2y ago
Unfortunately pgvector hasn't committed to hnsw
deep-jade•2y ago
Hey, pgvector now supports HNSW indexes.
adverse-sapphire•2y ago
News to me. Cool!
Maybe I was thinking of DiskANN or something
exotic-emeraldOP•2y ago
Ohhh that's awesome to hear! Thanks! 😄