Can Vectorize handle embeddings on non-text content e.g. images? [This page](https://developers.clou

Can Vectorize handle embeddings on non-text content e.g. images? This page suggests not as the "use case" column for its single embeddings model says "text"?

MMitya Can Vectorize handle embeddings on non-text content e.g. images? [This page](htt...

Isaac McFadyen•12/13/24, 9:41 PM

Vectorize absolutely can, it can use vectors from anything (I've even thrown facial recognition embeddings in and they worked well). What you need is an embedding model that can generate vectors from images.

Isaac McFadyen•12/13/24, 9:42 PM

Vectorize just stores the embeddings, it doesn't generate them. That's the purpose of a model from Workers AI or OpenAI or similar (Workers AI doesn't accept images but some other ones do).

Isaac McFadyen•12/13/24, 9:42 PM

Specifically you're looking for "multi-modal embedding models"

MityaOP•12/13/24, 9:46 PM

Oh - I was thinking that to use Vectorize I had to use CF's embeddings model, but if I understand you right I can use any? i.e. some that can handle images.

MityaOP•12/13/24, 9:48 PM

Lastly for tonight: if I store a bunch of user feedback strings in my Vectorize (the embeddings thereof), can I query it with something like "give me all the items about toilets", or would I need to feed it an example piece of feedback so it could find similar ones?

MMitya Lastly for tonight: if I store a bunch of user feedback strings in my Vectorize ...

Isaac McFadyen•12/13/24, 9:54 PM

Usually the model is designed for this use-case so it would work. You often embed the items directly, and then when you're embedding your question you add a special prefix that allows the embedding model to match it more closely.

Isaac McFadyen•12/13/24, 9:54 PM

It's often along the lines of Represent this sentence for searching relevant passages:Represent this sentence for searching relevant passages:

Isaac McFadyen•12/13/24, 9:55 PM

So you'd embed + store your feedback strings, and then embed Represent this sentence for searching relevant passages: give me all the items about toiletsRepresent this sentence for searching relevant passages: give me all the items about toilets and when you query Vectorize it should give you all the toilet-related feedback items

MityaOP•12/13/24, 9:56 PM

Ah interesting - but I'm not sure I understand the need for the "Represent this..." prefix?

MityaOP•12/13/24, 9:56 PM

What would happen if you just queried with an embedded "give me all the feedback about toilets" without that prefix?

MMitya Ah interesting - but I'm not sure I understand the need for the "Represent this....

Isaac McFadyen•12/13/24, 9:56 PM

It's just how the model was trained. It was trained to take a question + a prefix.

MMitya What would happen if you just queried with an embedded "give me all the feedback...

Isaac McFadyen•12/13/24, 9:57 PM

It would still work but likely a bit degraded because it wasn't trained that way.

MityaOP•12/13/24, 9:57 PM

Oh I see, so that's just a fixed piece of text I need to use?

Isaac McFadyen•12/13/24, 9:57 PM

I took that prefix directly from https://huggingface.co/mixedbread-ai/mxbai-embed-large-v1 (a popular open-source model) by the way, it'll be in the model description, yeah.

MityaOP•12/13/24, 9:57 PM

Right! Would never have spotted that. Appreciated.

ggu•12/19/24, 3:55 PM

Vectorize update:
Added support for range queries in metadata filters. Merry Christmas!

https://developers.cloudflare.com/vectorize/platform/changelog/

Cloudflare Docs

Changelog · Vectorize

Vero•12/19/24, 4:00 PM

@Vectorize

VVero @Vectorize⤴️

M.A.K•12/19/24, 4:02 PM

alright

Rahul gangotri•12/19/24, 4:03 PM

Can we also expect

Metadata filters without creating indexes for each
Create dynamic vector indexes programatically without the manual bindings

Andrew Brown•12/20/24, 7:29 PM

I attempted to record a video on how to use Vectorize but I failed at the following:

figuring out binding VECTORIZE

The documentation needs work in these areas.

EndiM•12/22/24, 9:31 PM

EndiM•12/22/24, 9:32 PM

Is anyone of the vectorize team Working today?

EndiM•12/22/24, 9:34 PM

I need someone to help me with an issue that was previously resolved by cloudflare, and is happening again. I do have all the information that it needs, but is something that needs to be resolved.

EndiM•12/23/24, 9:38 AM

Still awaiting!

EndiM•12/23/24, 9:39 AM

I see @Torianna @Tanmay Kapoor online, is one of you guys available?

itsmatteomanf•12/23/24, 9:40 AM

?pings

SuperHelpflare•12/23/24, 9:40 AM

Please do not ping community members for non-moderation reasons. Doing so will not solve your issue faster and will make people less likely to want to help you.

itsmatteomanf•12/23/24, 9:40 AM

This applies to Cloudflare employees, too. This server is not support, it's community support.

Iitsmatteomanf ?pings

EndiM•12/23/24, 9:40 AM

Hi matt

Torianna•12/23/24, 9:40 AM

https://tenor.com/view/rrane-battal-rrane-battal-k%C4%B1zg%C4%B1n-battal-k%C4%B1zg%C4%B1n-gif-25355985

Tenor

Iitsmatteomanf This applies to Cloudflare employees, too. This server is not support, it's comm...

EndiM•12/23/24, 9:43 AM

Aha

EndiM•12/23/24, 9:43 AM

EndiM•12/23/24, 9:45 AM

I thought I tagged cf employees, sorry

EEndiM I thought I tagged cf employees, sorry

itsmatteomanf•12/23/24, 9:52 AM

Even then, do not ping them unless you are told to do so.

Iitsmatteomanf Even then, do not ping them unless you are told to do so.

EndiM•12/23/24, 9:53 AM

Yeah, i was told to do so by cloudflare support on the web since yesterday.

Tanmay Kapoor•12/23/24, 10:00 AM

Hi @EndiM, is there a thread on dev community or detailed query you posted earlier? Can you share the link please?

Ashley•1/5/25, 7:28 PM

Are there any plans to increase the current dimension limit? OpenAI’s latest embedding model is over 3000, and while it’s possible to lower it, if you want more accuracy then it simply won’t be possible to use Vectorize

ajgeiss0702•1/8/25, 11:23 PM

can the vectorize http api docs be updated? I basically had to try random things then give up and searched in this channel before i saw somebody with the correct format

Moiz_08•1/9/25, 7:00 AM

I would really appreciate if somebody assit me to create an api for inserting the embeddings into vectorize.

Idle•1/10/25, 7:39 AM

@Community Champion

MMoiz_08 I would really appreciate if somebody assit me to create an api for inserting th...

ggu•1/11/25, 1:45 AM

Yeah what’s up?

Johnny•1/13/25, 2:43 AM

Hi, are there plan to increase the topk limit of 20 with metadata filtering? With chunked data a limit of 20 is severely limiting, especially for paginated search experiences.

makrdev•1/13/25, 11:58 AM

Hey guys, checked but couldn't find. What is the best approach to update metadata? Should we use upsert for that?

Can Vectorize handle embeddings on non-text content e.g. images? [This page](https://developers.clou

Similar Threads