It’s not meant as a replacement. Some folks want more indexes for isolating different use-cases, and

Ccosbgn 100 indexes is still fairly useless, or I'm not understanding how they should be...

M

Matt SilverlockOP•10/4/23, 12:45 PM

Hold tight on the metadata filtering. We’re working on it

N

nclevenger•10/4/23, 3:23 PM

Does anyone know what this error means:

VECTOR_QUERY_ERROR: Status + 500

VECTOR_QUERY_ERROR: Status + 500

VECTOR_QUERY_ERROR: Status + 500

VECTOR_QUERY_ERROR: Status + 500? I was running the exact query successfully earlier this morning, but now it is erroring.

Nnclevenger Does anyone know what this error means: `VECTOR_QUERY_ERROR: Status + 500`? I w...

J

Jerome•10/4/23, 3:26 PM

This means internal error, I can look in the internal log

JJerome This means internal error, I can look in the internal log

I

Isaac McFadyen•10/4/23, 3:27 PM

Just a heads-up that you can type

/cfrole

/cfrole

to get an orange Cloudflare role in the server

IIsaac McFadyen Just a heads-up that you can type `/cfrole` to get an orange Cloudflare role in ...

J

Jerome•10/4/23, 3:27 PM

yeah

JJerome This means internal error, I can look in the internal log

N

nclevenger•10/4/23, 3:28 PM

account id a826340b3b93189c9ebb7c0eaeba3c46 index blogs

IIsaac McFadyen Just a heads-up that you can type `/cfrole` to get an orange Cloudflare role in ...

J

Jerome•10/4/23, 3:28 PM

thx

JJerome 💥 thx

I

Isaac McFadyen•10/4/23, 3:28 PM

No problem!

IIsaac McFadyen Just a heads-up that you can type `/cfrole` to get an orange Cloudflare role in ...

O

Old Man Maker•10/4/23, 3:52 PM

What does that mean or refer to?

OOld Man Maker What does that mean or refer to?

J

Jerome•10/4/23, 3:53 PM

it's a command to mark one's discord account as belonging to an employee of cloudflare

O

Old Man Maker•10/4/23, 3:54 PM

oh I see

O

Old Man Maker•10/4/23, 3:54 PM

well now I'm just jealous

J

Jerome•10/4/23, 4:07 PM

@oldmanmeta have you seen my DM ?

J

Jerome•10/4/23, 4:11 PM

I mean: @nclevenger, have you seen my DM>

JJerome I mean: @nclevenger, have you seen my DM>

N

nclevenger•10/4/23, 4:23 PM

no ... I don't think i see it?

JJerome I mean: @nclevenger, have you seen my DM>

N

nclevenger•10/4/23, 4:25 PM

i found it - thanks!

O

Old Man Maker•10/4/23, 4:47 PM

I'm getting the same error as @nclevenger

VECTOR_QUERY_ERROR: Status + 404

VECTOR_QUERY_ERROR: Status + 404

VECTOR_QUERY_ERROR: Status + 404

VECTOR_QUERY_ERROR: Status + 404

O

Old Man Maker•10/4/23, 4:47 PM

just started happening

O

Old Man Maker•10/4/23, 4:54 PM

Account ID: 43310a46ee87ca6683a51510f7a57241

O

Old Man Maker•10/4/23, 4:55 PM

Can some please take a look for me.
The vectors are being created in the query correctly, calling <vectorize>.query() is failing

O

Old Man Maker•10/4/23, 4:56 PM

the index is ais-vec-bakedcontent-index

OOld Man Maker I'm getting the same error as @nclevenger ``` VECTOR_QUERY_ERROR: Status + 404...

J

Jerome•10/4/23, 5:08 PM

looking into it

JJerome looking into it

O

Old Man Maker•10/4/23, 5:09 PM

Thanks Sir

KKarl Hey, i'm playing around with vectorize and workers AI. Really impressed so far....

M

Matt SilverlockOP•10/5/23, 10:15 AM

You’d want some form of metadata filtering (we are working on it) for that.

MMatt Silverlock It’s not meant as a replacement. Some folks want more indexes for isolating diff...

Z

Zak @ insertchat.com•10/5/23, 11:24 AM

Yup, that's my case. Do you see any advantages/disadvantages to using one big index with all user vectors + metadata filtering by a user id vs. one index per user?

ZZak @ insertchat.com Yup, that's my case. Do you see any advantages/disadvantages to using one big in...

M

Matt SilverlockOP•10/5/23, 11:30 AM

It will depend on your index size. If the count of vectors per user is very small, and will remain so, a larger single index will remain “hot”

Z

Zak @ insertchat.com•10/5/23, 11:31 AM

Oh I see, there is a notion of hot/cold storage involved. What's your definition of small? Millions? Tens of millions? 1 billion?

ZZak @ insertchat.com Oh I see, there is a notion of hot/cold storage involved. What's your definition...

M

Matt SilverlockOP•10/5/23, 11:33 AM

per user or per index? Small would be thousands per user - over hundreds of thousands of users -> an index in the millions.

Z

Zak @ insertchat.com•10/5/23, 11:34 AM

I don't have more then a million vector per user

M

Matt SilverlockOP•10/5/23, 11:34 AM

To step back a second: it really doesn’t matter that much, and it probably doesn’t make a lot of sense to over engineer this right now

Z

Zak @ insertchat.com•10/5/23, 11:34 AM

The total in my db right now is between 5 and 10 millions vectors

M

Matt SilverlockOP•10/5/23, 11:35 AM

That’s fine.

M

Matt SilverlockOP•10/5/23, 11:36 AM

Write your raw embeddings to R2. If you want to change your approach, it’s much easier to repopulate an index vs a traditional RDBMS

Z

Zak @ insertchat.com•10/5/23, 11:39 AM

Will dump a few million vectors to Vectorize once we have filtering to see how it performs with a user id filter, if it's good then it's a go for production, and will see if we change it later to multiple indexes

Z

Zak @ insertchat.com•10/5/23, 12:35 PM

Can we also expect a way to CRUD a vector (row) directly by its id/uid?

ZZak @ insertchat.com Can we also expect a way to CRUD a vector (row) directly by its id/uid?

J

Jerome•10/5/23, 12:45 PM

there is

getByIds

getByIds

getByIds

getByIds and

deleteByIds

deleteByIds

deleteByIds

deleteByIds operations;

insert

insert

insert

insert and

upsert

upsert

upsert

upsert take the id you provide as well

Z

Zak @ insertchat.com•10/5/23, 12:46 PM

I'm an API user, don't have those (I think)

Z

Zak @ insertchat.com•10/5/23, 1:31 PM

Hopefully, API users will get some love from Cloudflare x)

P

prmptCoder•10/5/23, 3:14 PM

Is it possible to train or fine-tune the text-generation-model distilbert-sst-2-int8 and deploy@everyone

PprmptCoder Is it possible to train or fine-tune the text-generation-model distilbert-sst-2-...

O

Old Man Maker•10/5/23, 3:23 PM

AFAIK - model hosting with Hugging Face is on the road map to be exposed by cloudflare, so you should be able to at some point

A

Andrew Mayne•10/6/23, 12:07 AM

Hey folks! Two questions:

1. Is there some knack to saving meta data? Everything else saves in this example except the metadata:

const embedding = await getOpenAIEmbedding(description, env.OPENAI_KEY);
await env.VECTORIZE.upsert([{ id: promptId, values: embedding, metadata:{ title:"Updated title", description: "Description"} }]);

console.log("Item vector added:", { title: title, description: description })

2. Everytime I update from the CLI my vector binding are erased. Adding this to the TOML doesn't seem to help:

vectorize = [
{ binding = "VECTORIZE", index_name = "my-index" }
]

Or:

[[vectorize]]
binding = "VECTORIZE"
index_name = "my-index"

AAndrew Mayne Hey folks! Two questions: 1. Is there some knack to saving meta data? Everythin...

O

Old Man Maker•10/6/23, 2:48 AM

Keep in mind that metadata as a type may change in future if filtering by metadata is added.

At the moment, this is how I create it:

//I defined a new object type for the metadata - MetadataSchema 
let newMetaData:MetadataSchema ={
    d1Key: keyValue,
    prjRef: projectRef,
    accRef: accountRef,
    parentRef:parentRef
}

//Stuff the object in there
const metaRecord:Record<string,VectorizeVectorMetadata>= { 
    "data": JSON.stringify(newMetaData)
};

//Add to the vector
let tempVec:VectorizeVector ={
    id:id,
    values: data[0], //the embeddings
    namespace:<The Namespace>,
    metadata:metaRecord
}

//I defined a new object type for the metadata - MetadataSchema 
let newMetaData:MetadataSchema ={
    d1Key: keyValue,
    prjRef: projectRef,
    accRef: accountRef,
    parentRef:parentRef
}

//Stuff the object in there
const metaRecord:Record<string,VectorizeVectorMetadata>= { 
    "data": JSON.stringify(newMetaData)
};

//Add to the vector
let tempVec:VectorizeVector ={
    id:id,
    values: data[0], //the embeddings
    namespace:<The Namespace>,
    metadata:metaRecord
}

//I defined a new object type for the metadata - MetadataSchema 
let newMetaData:MetadataSchema ={
    d1Key: keyValue,
    prjRef: projectRef,
    accRef: accountRef,
    parentRef:parentRef
}

//Stuff the object in there
const metaRecord:Record<string,VectorizeVectorMetadata>= { 
    "data": JSON.stringify(newMetaData)
};

//Add to the vector
let tempVec:VectorizeVector ={
    id:id,
    values: data[0], //the embeddings
    namespace:<The Namespace>,
    metadata:metaRecord
}

//I defined a new object type for the metadata - MetadataSchema 
let newMetaData:MetadataSchema ={
    d1Key: keyValue,
    prjRef: projectRef,
    accRef: accountRef,
    parentRef:parentRef
}

//Stuff the object in there
const metaRecord:Record<string,VectorizeVectorMetadata>= { 
    "data": JSON.stringify(newMetaData)
};

//Add to the vector
let tempVec:VectorizeVector ={
    id:id,
    values: data[0], //the embeddings
    namespace:<The Namespace>,
    metadata:metaRecord
}

Ccfnathan Can you explain what behavior you're seeing a bit more? It sounds like the upser...

A

Andrew Mayne•10/6/23, 9:56 PM

I get a null value when I try to get the metadata. I can't tell if it's not added or not found:

I can retrieve the id and score, but not the meta.

Ccfnathan for (2): do you mean your Worker loses your Vectorize binding (e.g. `env.VECTORI...

A

Andrew Mayne•10/6/23, 10:00 PM

npm install wrangler@latest install 3.6.0, so that's what I've been using.

npm install wrangler@3.11.0 also installs 3.6.0.

npx wrangler deploy works though.

To be honest, I may be completely ignorant of how npm install works.

It’s not meant as a replacement. Some folks want more indexes for isolating different use-cases, and

Similar Threads

Similar Threads

Similar Threads