Cloudflare Developers•8mo ago

Vectorize supports up to 1578 vector dimension

Yyevgen Vectorize supports up to 1578 vector dimension

yinxingmaiming6409•5/20/25, 3:13 AM

Can I use Vectorize using only the HTTP protocol? What is the speed limit for this access.

Yyinxingmaiming6409 Can I use Vectorize using only the HTTP protocol? What is the speed limit for th...

Viktor•5/20/25, 2:21 PM

Vectorize has a REST api -> https://developers.cloudflare.com/api/resources/vectorize/

Cloudflare API | Vectorize

Interact with Cloudflare's products and services via the Cloudflare API

Deda•5/20/25, 8:54 PM

I have a question, is it possible to make an API that takes 2 vectors from the database, and it returns a position of vector B in a table of similarity of vector A against other vectors in the database?

Deda•5/20/25, 8:54 PM

I hope the question is not confusing -.-

Deda•5/20/25, 8:56 PM

example response: Vector B is in position of 52 (meaning 52 vectors are more similar than vector B to the vector A)

Tony•5/21/25, 12:43 AM

Hi all! Quick question just about to evaluate Vectorize. Does Vectorise need a CF Worker to work? Or can I use it to connect from other clients? Thanks!

DDeda I have a question, is it possible to make an API that takes 2 vectors from the d...

Viktor•5/21/25, 9:02 AM

Not really, at least not in a clean way. You could query vector a with topK = 100 (maximum possible when not using metadata) and loop it until you find the id of vector b in there. Index 0 will be Vector A (as it's 100% equal to the one you queried), and index 99 will be the one with the least similarity. But, as said, that's not clean and only works if there are max. 98 more similar vectors then vector B

TTony Hi all! Quick question just about to evaluate Vectorize. Does Vectorise need a C...

Viktor•5/21/25, 9:02 AM

Vectorize has a REST api that does work outside workers -> https://developers.cloudflare.com/api/resources/vectorize/

Cloudflare API | Vectorize

Interact with Cloudflare's products and services via the Cloudflare API

nico escudero•5/21/25, 8:20 PM

Anyone have any repos/guides/videos of RAG pipelines being built fully on Clouldflare stack? Looking for some inspo

Dev•5/24/25, 2:46 AM

Hi, why can't we use BGE-M3 embedding model (@cf/baai/bge-m3) to create vector index?

Only these model are available to choose from: [ "@cf/baai/bge-small-en-v1.5", "@cf/baai/bge-base-en-v1.5", "@cf/baai/bge-large-en-v1.5", "openai/text-embedding-ada-002", "cohere/embed-multilingual-v2.0" ]

yinxingmaiming6409•5/24/25, 5:44 AM

When should we consider encapsulating the official SDK of C #?

DDev Hi, why can't we use BGE-M3 embedding model (@cf/baai/bge-m3) to create vector i...

yevgenOP•5/25/25, 11:09 AM

please ask in #workers-ai

Steak•5/25/25, 9:13 PM

Has anyone seen this Vectorize error?

VECTOR_QUERY_ERROR (code = 40006): invalid query vector, expected 1024 dimensions, and got 0 dimensions

My index is definitely set to 1024 dimensions, and I’m querying with a plain JS array of length 1024. Even a hardcoded array fails. Storage is under 600 vectors. Is this a known issue or am I missing something obvious?

Steak•5/25/25, 10:30 PM

I adjusted the query method call, and it worked.

7777777•5/29/25, 2:02 AM

I'm getting the following error locally

✘ [ERROR] Uncaught (in promise) TypeError: Cannot read properties of undefined (reading 'insert')

env.VECTORIZE.insert(vectors)

env.VECTORIZE.insert(vectors)

I'm running

npm run dev --experimental-vectorize-bind-to-prod

npm run dev --experimental-vectorize-bind-to-prod

and wrangler is showing

- Vectorize Indexes:
  - VECTORIZE: <MY_INDEX> [connected to remote resource]

- Vectorize Indexes:
  - VECTORIZE: <MY_INDEX> [connected to remote resource]

on start up?

zensin•6/1/25, 1:37 PM

vectorize.index.invalid_config - Dimensions must
  be in range: [32, 1536] [code: 3003]

vectorize.index.invalid_config - Dimensions must
  be in range: [32, 1536] [code: 3003]

yinxingmaiming6409•6/2/25, 3:19 AM

Is there a way to use CF's AI to extract image embeddings?

beingmudit [WePlayDOS]•6/3/25, 5:49 PM

Hey CF Team, is something off with vectorize indexing latencies? I am continously getting vectors not found via getByIds. Can anyone update the status?

beingmudit [WePlayDOS]•6/3/25, 5:50 PM

@yevgen @garvitg

yinxingmaiming6409•6/6/25, 10:01 AM

Can each vector database have a maximum of 5 million pieces of data?

yinxingmaiming6409•6/6/25, 10:27 AM

What type of data is ndjson insertion?

yinxingmaiming6409•6/6/25, 10:40 AM

{'result': None, 'success': False, 'errors': [{'code': 1005, 'message': 'vectorize.unknown_content_type'}], 'messages': []}

yinxingmaiming6409•6/6/25, 10:41 AM

yinxingmaiming6409•6/6/25, 10:41 AM

Why can't I upload it?

Yyinxingmaiming6409 {'result': None, 'success': False, 'errors': [{'code': 1005, 'message': 'vectori...

Isaac McFadyen•6/6/25, 1:18 PM

Not sure if this is your specific issue, but the ID must be a string not a number: https://developers.cloudflare.com/vectorize/best-practices/insert-vectors/

IIsaac McFadyen Not sure if this is your specific issue, but the ID must be a string not a numbe...

yinxingmaiming6409•6/6/25, 2:40 PM

I want to know a few questions, can an index only store a maximum of 5 million data?

Yyinxingmaiming6409 I want to know a few questions, can an index only store a maximum of 5 million d...

Isaac McFadyen•6/6/25, 2:45 PM

See https://developers.cloudflare.com/vectorize/platform/limits/

IIsaac McFadyen See https://developers.cloudflare.com/vectorize/platform/limits/

yinxingmaiming6409•6/6/25, 2:52 PM

My translation is not quite accurate. It seems to mean that there is no limit on the frequency of HTTP requests?

IIsaac McFadyen Not sure if this is your specific issue, but the ID must be a string not a numbe...

yinxingmaiming6409•6/6/25, 4:10 PM

Error code: 400 - {'result': None, 'success': False, 'errors': [{'code': 1005, 'message': 'vectorize.unknown_content_type'}], 'messages': []}

yinxingmaiming6409•6/6/25, 4:10 PM

yinxingmaiming6409•6/6/25, 4:10 PM

Where exactly is the data format wrong?

yinxingmaiming6409•6/6/25, 4:40 PM

Is there no example explaining how ndJson data format works? I really can't upload it

yinxingmaiming6409•6/7/25, 3:06 AM

@kian@Isaac McFadyen help me

Yyinxingmaiming6409 @kian@Isaac McFadyen help me

Isaac McFadyen•6/7/25, 3:10 AM

?pings

SuperHelpflare•6/7/25, 3:10 AM

Please do not ping community members for non-moderation reasons. Doing so will not solve your issue faster and will make people less likely to want to help you.

yinxingmaiming6409•6/7/25, 5:59 AM

I can't use either Node.js or Python SDK, but the errors are different.

yinxingmaiming6409•6/7/25, 6:00 AM

Dev•6/8/25, 3:15 AM

is there any way i can view the saved vector in a vectorize index? On cloudflare dashboard, when i click on the vector index, it just displays the stats and analytics of the index, i want to view the actual saved vectors

DDev is there any way i can view the saved vector in a vectorize index? On cloudflare...

faisal•6/9/25, 2:13 AM

Very important feature to have

Yyinxingmaiming6409 Can each vector database have a maximum of 5 million pieces of data?

yevgenOP•6/9/25, 1:13 PM

yes

Yyevgen yes

yinxingmaiming6409•6/9/25, 1:14 PM

I have been unable to insert data, can you help me? I really want to use this now.

Yyinxingmaiming6409 I have been unable to insert data, can you help me? I really want to use this no...

yevgenOP•6/9/25, 1:16 PM

please read https://developers.cloudflare.com/vectorize/best-practices/insert-vectors/ Usually people struggle with inserting vectors before reading this page

Cloudflare Docs

Insert vectors

Vectorize indexes allow you to insert vectors at any point: Vectorize will optimize the index behind the scenes to ensure that vector search remains efficient, even as new vectors are added or existing vectors updated.

yevgenOP•6/9/25, 1:17 PM

specifically examples section https://developers.cloudflare.com/vectorize/best-practices/insert-vectors/#examples

Cloudflare Docs

Insert vectors

yevgenOP•6/9/25, 1:18 PM

also LLM should help you if you refer this doc to them first https://developers.cloudflare.com/vectorize/llms-full.txt

Yyevgen please read https://developers.cloudflare.com/vectorize/best-practices/insert-ve...

yinxingmaiming6409•6/9/25, 1:20 PM

I have reviewed these and the Python SDK I am using is your official SDK. I think apart from the possibility of the ndjson format being incorrect, everything else cannot be wrong. But I didn't see a detailed introduction to the ndjson format on the official website, I only saw that each line contains one json data. I tested it but it's not possible.

yinxingmaiming6409•6/9/25, 1:21 PM