Cloudflare Developers•13mo ago

I'd take a look at the documentation for your model. If it's higher than `1536` then you'll obviousl

I'd take a look at the documentation for your model. If it's higher than

then you'll obviously have to somehow reduce it to

but if it's lower then you just have to use the lower dimension.

is common for open source models.

IIsaac McFadyen I'd take a look at the documentation for your model. If it's higher than `1536` ...

Mitya•12/13/24, 8:46 PM

Thanks very much for the info. I'll do some reading.

Mitya•12/13/24, 9:17 PM

Just checking some terminology. When the limits page says a maximum of 5,000,000 "vectors", that's akin to "rows" in a conventional DB, right? So vectors = rows, and embeddings = the numbers that make up that vector, right?

MMitya Just checking some terminology. When the limits page says a maximum of 5,000,000...

Isaac McFadyenOP•12/13/24, 9:26 PM

Correct, yeah.
1 embedding = <n> numbers in an array where <n> is the dimension
5 000 000 embeddings = 5 million arrays each with <n> numbers
An embedding is a type of vector, but not all vectors are embeddings. In the case of Machine Learning they usually are though.

Mitya•12/13/24, 9:28 PM

OK great, so if I wanted to store a "row" in my Vectorize DB for every product in my relational DB, I'd be limited to 5million.

Isaac McFadyenOP•12/13/24, 9:29 PM

Correct, yeah.

Mitya•12/13/24, 9:31 PM

I really hope they give you a job at CF for all your expertise/help!

Mitya•12/13/24, 9:37 PM

Can Vectorize handle embeddings on non-text content e.g. images? This page suggests not as the "use case" column for its single embeddings model says "text"?

MMitya Can Vectorize handle embeddings on non-text content e.g. images? [This page](htt...

Isaac McFadyenOP•12/13/24, 9:41 PM

Vectorize absolutely can, it can use vectors from anything (I've even thrown facial recognition embeddings in and they worked well). What you need is an embedding model that can generate vectors from images.

Isaac McFadyenOP•12/13/24, 9:42 PM

Vectorize just stores the embeddings, it doesn't generate them. That's the purpose of a model from Workers AI or OpenAI or similar (Workers AI doesn't accept images but some other ones do).

Isaac McFadyenOP•12/13/24, 9:42 PM

Specifically you're looking for "multi-modal embedding models"

Mitya•12/13/24, 9:46 PM

Oh - I was thinking that to use Vectorize I had to use CF's embeddings model, but if I understand you right I can use any? i.e. some that can handle images.

Mitya•12/13/24, 9:48 PM

Lastly for tonight: if I store a bunch of user feedback strings in my Vectorize (the embeddings thereof), can I query it with something like "give me all the items about toilets", or would I need to feed it an example piece of feedback so it could find similar ones?

MMitya Lastly for tonight: if I store a bunch of user feedback strings in my Vectorize ...

Isaac McFadyenOP•12/13/24, 9:54 PM

Usually the model is designed for this use-case so it would work. You often embed the items directly, and then when you're embedding your question you add a special prefix that allows the embedding model to match it more closely.

Isaac McFadyenOP•12/13/24, 9:54 PM

It's often along the lines of Represent this sentence for searching relevant passages:Represent this sentence for searching relevant passages:

Isaac McFadyenOP•12/13/24, 9:55 PM

So you'd embed + store your feedback strings, and then embed Represent this sentence for searching relevant passages: give me all the items about toiletsRepresent this sentence for searching relevant passages: give me all the items about toilets and when you query Vectorize it should give you all the toilet-related feedback items

Mitya•12/13/24, 9:56 PM

Ah interesting - but I'm not sure I understand the need for the "Represent this..." prefix?

Mitya•12/13/24, 9:56 PM

What would happen if you just queried with an embedded "give me all the feedback about toilets" without that prefix?

MMitya Ah interesting - but I'm not sure I understand the need for the "Represent this....

Isaac McFadyenOP•12/13/24, 9:56 PM

It's just how the model was trained. It was trained to take a question + a prefix.

MMitya What would happen if you just queried with an embedded "give me all the feedback...

Isaac McFadyenOP•12/13/24, 9:57 PM

It would still work but likely a bit degraded because it wasn't trained that way.

Mitya•12/13/24, 9:57 PM

Oh I see, so that's just a fixed piece of text I need to use?

Isaac McFadyenOP•12/13/24, 9:57 PM

I took that prefix directly from https://huggingface.co/mixedbread-ai/mxbai-embed-large-v1 (a popular open-source model) by the way, it'll be in the model description, yeah.

Mitya•12/13/24, 9:57 PM

Right! Would never have spotted that. Appreciated.

ggu•12/19/24, 3:55 PM

Vectorize update:
Added support for range queries in metadata filters. Merry Christmas!

https://developers.cloudflare.com/vectorize/platform/changelog/

Cloudflare Docs

Changelog · Vectorize

Vero•12/19/24, 4:00 PM

@Vectorize

VVero @Vectorize⤴️

M.A.K•12/19/24, 4:02 PM

alright

Rahul gangotri•12/19/24, 4:03 PM

Can we also expect

Metadata filters without creating indexes for each
Create dynamic vector indexes programatically without the manual bindings

Andrew Brown•12/20/24, 7:29 PM

I attempted to record a video on how to use Vectorize but I failed at the following:

figuring out binding VECTORIZE

The documentation needs work in these areas.

EndiM•12/22/24, 9:31 PM

EndiM•12/22/24, 9:32 PM

Is anyone of the vectorize team Working today?

EndiM•12/22/24, 9:34 PM

I need someone to help me with an issue that was previously resolved by cloudflare, and is happening again. I do have all the information that it needs, but is something that needs to be resolved.

EndiM•12/23/24, 9:38 AM

Still awaiting!

EndiM•12/23/24, 9:39 AM

I see @Torianna @Tanmay Kapoor online, is one of you guys available?

itsmatteomanf•12/23/24, 9:40 AM

?pings

SuperHelpflare•12/23/24, 9:40 AM

Please do not ping community members for non-moderation reasons. Doing so will not solve your issue faster and will make people less likely to want to help you.

itsmatteomanf•12/23/24, 9:40 AM

This applies to Cloudflare employees, too. This server is not support, it's community support.