Just to put this one out there for CF—I am storing vectors with partially random keys (like `${uniqu

Just to put this one out there for CF—I am storing vectors with partially random keys (like

${uniqueId}:${randomId}

${uniqueId}:${randomId}

${uniqueId}:${randomId}

${uniqueId}:${randomId}, for chunking a piece of content under the token limit). I’d like to be able to, at some point, delete those items without having to guess where they are by supplying nearby vectors. I’m not fussy about how that would be fulfilled, but I like the syntax from KV where

get

get

just bulk-loads every item and allows a

prefix

prefix

prefix

prefix.

Hhuw Just to put this one out there for CF—I am storing vectors with partially random...

huwOP•11/1/23, 11:05 PM

Also gonna request the ability to paginate a search query. If I find results in my search that are out of date, I’d like to exclude them and re-run the search to find the next K results, without having to optimistically search for a large K and filter it down post-hoc

LemonJelloo•11/2/23, 1:55 AM

Hi, everyone, this is my first time using vectorize and worker. I am following this tutorial https://developers.cloudflare.com/vectorize/get-started/intro/#2-create-an-index to create a worker and access my index created. However when I tried to run part 4 of the tutorial locally, it gives me an error and I found out that my env is null although I followed exactly how the tutorial set everything up. I used two other devices to try to run the code locally but both gave me same error. Does anyone know why this is the case? Thank you so much.

Introduction to Vectorize · Vectorize

Vectorize is currently in public beta and is enabled for all developers on Workers Paid plans. During the beta, you may run into bugs and instability …

LLemonJelloo Hi, everyone, this is my first time using vectorize and worker. I am following t...

Sam•11/2/23, 12:05 PM

Yeah I don't think the bindings work for local testing. You'll probably need to deploy it first and then test it.

Ajay•11/2/23, 12:59 PM

how do you bind multiple vector databases? I tried what's documented here
https://developers.cloudflare.com/workers/wrangler/configuration/#vectorize-indexes
but that didn't work

Configuration - Wrangler · Cloudflare Workers docs

Use a

wrangler.toml

wrangler.toml

configuration file to customize the development and deployment setup for your Worker project and other Developer Platform …

Configuration - Wrangler · Cloudflare Workers docs

Ajay•11/2/23, 1:01 PM

also, there's a typo in the docs

zegevlier•11/2/23, 1:02 PM

If you want you can submit a PR to fix it: https://github.com/cloudflare/cloudflare-docs, if not I can do that

kian•11/2/23, 1:03 PM

There's one open already from September

zegevlier•11/2/23, 1:03 PM

alright then NotLikeThis

Ajay•11/2/23, 1:06 PM

aside from that, can either of you "assign an array of the below object to the vectorize key". it works for me with just one DB. Using binding and index_name keys.

AAjay aside from that, can either of you "assign an array of the below object to the v...

huwOP•11/2/23, 11:35 PM

Here’s what I have

vectorize = [
  { binding = "embeddings-development", index_name="embeddings-development" },
  { binding = "embeddings-staging", index_name="embeddings-staging" },
  { binding = "embeddings-production", index_name="embeddings-production" }
]

vectorize = [
  { binding = "embeddings-development", index_name="embeddings-development" },
  { binding = "embeddings-staging", index_name="embeddings-staging" },
  { binding = "embeddings-production", index_name="embeddings-production" }
]

(I think that’s what you mean?)

Hhuw Here’s what I have 🙂 ```toml vectorize = [ { binding = "embeddings-developmen...

Matt Silverlock•11/3/23, 11:45 AM

Yes!

charl.dev•11/5/23, 6:29 PM

are there rough timings from setting till being able to query it?

Ccharl.dev are there rough timings from setting till being able to query it?

Matt Silverlock•11/6/23, 5:12 PM

Rephrase?

charl.dev•11/6/23, 5:22 PM

so from setting a vector and then querying it. e.g. kv is like up to 2 secs

like is it 'instantly' queryable after setting

Ccharl.dev so from setting a vector and then querying it. e.g. kv is like up to 2 secs lik...

Matt Silverlock•11/6/23, 7:26 PM

Yes.

SSam Hey guys. Getting this error trying to upload my vectors using the cli: ✘ [ERRO...

Sam•11/7/23, 5:03 PM

Has anyone used pandas or polars with openai to create their embeddings? Created some embeddings and albeit sending the ndjson file the vectors aren't getting inserted. Still getting the error displayed here.

scotto•11/8/23, 12:55 PM

Team has a date for metadata filtering ?

Sscotto Team has a date for metadata filtering ?

Matt Silverlock•11/8/23, 1:13 PM

Within the next few weeks (before end of year)

SSam Has anyone used pandas or polars with openai to create their embeddings? Created...

Matt Silverlock•11/8/23, 1:13 PM

Can you confirm it’s NDJSON (show some sample lines)? How many vectors per file?

MMatt Silverlock Can you confirm it’s NDJSON (show some sample lines)? How many vectors per file?

Sam•11/8/23, 1:40 PM

Yup. NDJSON, 500 vectors for a single file.

SSam Yup. NDJSON, 500 vectors for a single file.

Matt Silverlock•11/8/23, 1:47 PM

That should be fine. Metadata? 100% sure no trailing commas? Names too long?

MMatt Silverlock That should be fine. Metadata? 100% sure no trailing commas? Names too long?

Sam•11/8/23, 1:50 PM

I had multiple versions and none seemed to work. In one I omitted the metadata field, and in the other I included it and both had the same results.

SSam I had multiple versions and none seemed to work. In one I omitted the metadata f...

Matt Silverlock•11/8/23, 1:51 PM

Can you share a sample? Note that the docs have limits on ID length, etc. Without a sample we're just guessing at this point

MMatt Silverlock Can you share a sample? Note that the docs have limits on ID length, etc. Withou...

Sam•11/8/23, 1:56 PM

Sure! Here's the example without the metadata.

embeddings.ndjson18.56MB

SSam Sure! Here's the example without the metadata.

Matt Silverlock•11/8/23, 1:57 PM

embedding

embedding

isn't correct. It should be

values

values

SSam Sure! Here's the example without the metadata.

Matt Silverlock•11/8/23, 1:57 PM

https://developers.cloudflare.com/vectorize/learning/insert-vectors/

Insert vectors · Vectorize

Vectorize indexes allow you to insert vectors at any point: Vectorize will optimize the index behind the scenes to ensure that vector search remains …

Sam•11/8/23, 2:04 PM

Yeah I also created a version with that and it still didn't work. I can't seem to generate the truncated (500 line ) version of the most recent file I uploaded because OpenAI deprecated their api. But here's the 1000 vector version.

embeddings.ndjson31.34MB

Sam•11/8/23, 2:05 PM

I had a version of that as well and that didn't work. This would be truncated to 500 vectors.

SSam I had a version of that as well and that didn't work. This would be truncated to...

Matt Silverlock•11/8/23, 2:13 PM

Let us take a look.

MMatt Silverlock Let us take a look.

Sam•11/8/23, 3:42 PM

It's the file attached to this latest message.

SSam Yeah I also created a version with that and it still didn't work. I can't seem t...

Matt Silverlock•11/8/23, 6:35 PM

We're pushing a bug fix in a bit: seeing an issue with the REST API (vs. the Workers API) that's preventing insert in some cases. Will reply back once deployed.

Sam•11/8/23, 6:37 PM

Thanks!

SSam Thanks!

Matt Silverlock•11/9/23, 1:10 PM

This should be good now - I can import your file.

MMatt Silverlock This should be good now - I can import your file.

Sam•11/9/23, 1:10 PM

Thanks!

Jerome•11/10/23, 2:40 PM

Hey there! Vectorize has been out a month now. We'd love your feedback if you have some that you haven't shared yet. What's good, what's bad, what could be better, we take it all.

huwOP•11/13/23, 4:47 AM

A question about metadata filtering—what will be the pros and cons for using the namespaces feature vs defining a namespace in metadata and filtering on that? Query speed?

(I’m looking at building a system that searches across multiple namespaces at once and interleaves their results)

Hhuw A question about metadata filtering—what will be the pros and cons for using the...

Old Man Maker•11/13/23, 10:21 AM

I'm sure Matt will clarify anything I get wrong here, but my Assumption (with a capital A) is that namespaces, much like the way they are implemented in KV for example, are a way for you to separate your vectorize instances entirely - e.g, you are binding to a namespace, and the vectorize instances you have in that namespace are available to query on.

Filtering - the difference would be that your metadata filtering is allowing you to reduce the size and number of vectors you are performing a query over, if that makes sense. I'm not sure if that would impact billing (because you are charged on the number of vector dimensions you query against as well as storage of said vectors) - I'm sure all of this will be announced along with the release of those changes, which hopefully are not too far away.

Jerome•11/13/23, 2:20 PM

@oldmanmeta @huw

namespaces [...] are a way for you to separate your vectorize instances entirely - e.g, you are binding to a namespace, and the vectorize instances you have in that namespace are available to query on.

Jerome•11/13/23, 2:23 PM

spot on; also metadata filtering isn't available yet, so namespace filtering is the only filtering besides vector query we have right now.
Once metadata filtering lands, filtering on namespace and filtering on a namespace property in metadata will be functionally identical, although namespace filtering should induce lower latency due to the fact that we're able to index it in a way that makes it faster overall.

JJerome spot on; also metadata filtering isn't available yet, so namespace filtering is ...

huwOP•11/13/23, 9:50 PM

Exactly the answer I was looking for, thank you! I think for my use case it’s gonna make sense to use metadata filtering long-term

wadefletch•11/14/23, 5:26 AM

Where are the docs for namespace filtering?

Wwadefletch Where are the docs for namespace filtering?

Matt Silverlock•11/14/23, 1:38 PM

namespaces are part of the TypeScript/JS API; we haven't documented them yet as there was a bug when we initially launched. On our TODO list.

steyblind•11/16/23, 3:58 PM

OK, so I'm play-testing this, and I'm only a few weeks in to working with all this the fun offerings here, so looking for guidance based on what's coming (or not):

Goal:
- multi-tenant RAG CX via Slack
- support alpha concept (2-3 potential customers)

Context:
- I'm all set with workers, queues, data sync, AI gateway, etc.
- sync'ing data from Hubspot, Slack, Gong.io ~2.5k records per customer, maybe? Would expect this to be ~10k-25k+ in a production setting w/long-lived customer. Or more.

Experiment:
- How can Vectorize support this? (rip & replace pinecone)

System Design:
- Vectorize:

id: (hex sha1 of text), values: [vector of text], metadata: {text, companyId}

id: (hex sha1 of text), values: [vector of text], metadata: {text, companyId}

- D1 (possibly KV instead?): proxy for clerk.com Organization object + maps Slack IDs to users to Companies

Usage (simplified):
utterance from Slack

get company ID

query vectorize for context

return to response builder

bounce off LLM + augmented context

respond to Slack

So now what?
At this point I'm just waiting for filters or namespaces I guess, before this is "usable"?

Tumbzilla•11/16/23, 4:08 PM

Getting the following errors fairly frequently.

VECTOR_QUERY_ERROR (code = 2006)
VECTOR_QUERY_ERROR (code = 1000)

Couldn't find any docs on how to resolve. Anyone know of any docs that might point me in the right direction?

TTumbzilla Getting the following errors fairly frequently. VECTOR_QUERY_ERROR (code = 200...

Matt Silverlock•11/16/23, 5:54 PM

Is this just on a query?

MMatt Silverlock Is this just on a query?

Tumbzilla•11/16/23, 6:15 PM

yep. Just on queries. Roughly 1/3 of my requests are failing this way.

Tumbzilla•11/16/23, 6:16 PM

most of them are the first error code (2006)

TTumbzilla yep. Just on queries. Roughly 1/3 of my requests are failing this way.

Matt Silverlock•11/16/23, 6:17 PM

Can you share your index ID here?

MMatt Silverlock Can you share your index ID here?

Tumbzilla•11/16/23, 6:27 PM

just DM'ed it to you.

Hhuw Here’s what I have 🙂 ```toml vectorize = [ { binding = "embeddings-developmen...

JuanWTF•11/16/23, 10:44 PM

Just to confirm, is this the right way to bind many indexes to a worker?

vectorize = [ { binding = "embeddings-development", index_name="embeddings-development" }, { binding = "embeddings-staging", index_name="embeddings-staging" }, { binding = "embeddings-production", index_name="embeddings-production" } ]

Just to put this one out there for CF—I am storing vectors with partially random keys (like `${uniqu

Similar Threads

Similar Threads

Similar Threads