Cloudflare Developers•7mo ago

I want to know a few questions, can an index only store a maximum of 5 million data?

Yyinxingmaiming6409 I want to know a few questions, can an index only store a maximum of 5 million d...

Isaac McFadyen•6/6/25, 2:45 PM

See https://developers.cloudflare.com/vectorize/platform/limits/

IIsaac McFadyen See https://developers.cloudflare.com/vectorize/platform/limits/

yinxingmaiming6409OP•6/6/25, 2:52 PM

My translation is not quite accurate. It seems to mean that there is no limit on the frequency of HTTP requests?

IIsaac McFadyen Not sure if this is your specific issue, but the ID must be a string not a numbe...

yinxingmaiming6409OP•6/6/25, 4:10 PM

Error code: 400 - {'result': None, 'success': False, 'errors': [{'code': 1005, 'message': 'vectorize.unknown_content_type'}], 'messages': []}

yinxingmaiming6409OP•6/6/25, 4:10 PM

yinxingmaiming6409OP•6/6/25, 4:10 PM

Where exactly is the data format wrong?

yinxingmaiming6409OP•6/6/25, 4:40 PM

Is there no example explaining how ndJson data format works? I really can't upload it

yinxingmaiming6409OP•6/7/25, 3:06 AM

@kian@Isaac McFadyen help me

Yyinxingmaiming6409 @kian@Isaac McFadyen help me

Isaac McFadyen•6/7/25, 3:10 AM

?pings

SuperHelpflare•6/7/25, 3:10 AM

Please do not ping community members for non-moderation reasons. Doing so will not solve your issue faster and will make people less likely to want to help you.

yinxingmaiming6409OP•6/7/25, 5:59 AM

I can't use either Node.js or Python SDK, but the errors are different.

yinxingmaiming6409OP•6/7/25, 6:00 AM

Dev•6/8/25, 3:15 AM

is there any way i can view the saved vector in a vectorize index? On cloudflare dashboard, when i click on the vector index, it just displays the stats and analytics of the index, i want to view the actual saved vectors

DDev is there any way i can view the saved vector in a vectorize index? On cloudflare...

faisal•6/9/25, 2:13 AM

Very important feature to have

Yyinxingmaiming6409 Can each vector database have a maximum of 5 million pieces of data?

yevgen•6/9/25, 1:13 PM

yes

Yyevgen yes

yinxingmaiming6409OP•6/9/25, 1:14 PM

I have been unable to insert data, can you help me? I really want to use this now.

Yyinxingmaiming6409 I have been unable to insert data, can you help me? I really want to use this no...

yevgen•6/9/25, 1:16 PM

please read https://developers.cloudflare.com/vectorize/best-practices/insert-vectors/ Usually people struggle with inserting vectors before reading this page

Cloudflare Docs

Insert vectors

Vectorize indexes allow you to insert vectors at any point: Vectorize will optimize the index behind the scenes to ensure that vector search remains efficient, even as new vectors are added or existing vectors updated.

yevgen•6/9/25, 1:17 PM

specifically examples section https://developers.cloudflare.com/vectorize/best-practices/insert-vectors/#examples

Cloudflare Docs

Insert vectors

yevgen•6/9/25, 1:18 PM

also LLM should help you if you refer this doc to them first https://developers.cloudflare.com/vectorize/llms-full.txt

Yyevgen please read https://developers.cloudflare.com/vectorize/best-practices/insert-ve...

yinxingmaiming6409OP•6/9/25, 1:20 PM

I have reviewed these and the Python SDK I am using is your official SDK. I think apart from the possibility of the ndjson format being incorrect, everything else cannot be wrong. But I didn't see a detailed introduction to the ndjson format on the official website, I only saw that each line contains one json data. I tested it but it's not possible.

yinxingmaiming6409OP•6/9/25, 1:21 PM

Yyinxingmaiming6409 I have reviewed these and the Python SDK I am using is your official SDK. I thin...

yevgen•6/9/25, 1:30 PM

I suspect that some of the metadata you insert has string with

U+2028

U+2028

in it withing a JSON string. We have reports of this issue recently.

yevgen•6/9/25, 1:31 PM

I recommend testing vectors insert without metadata attached to confirm the issue.

Yyevgen I suspect that some of the metadata you insert has string with `U+2028` in it wi...

yinxingmaiming6409OP•6/9/25, 2:57 PM

Error code: 400 - {'result': None, 'success': False, 'errors': [{'code': 1005, 'message': 'vectorize.unknown_content_type'}], 'messages': []}

yinxingmaiming6409OP•6/9/25, 2:57 PM

He's still like this, it's too difficult.

yinxingmaiming6409OP•6/9/25, 2:58 PM

I also use the official SDK, and for the simplest data, I don't think there should be any errors unless there is a problem with the official SDK?

Yyevgen please read https://developers.cloudflare.com/vectorize/best-practices/insert-ve...

yinxingmaiming6409OP•6/9/25, 3:08 PM

How else can I investigate? Can you help me?

yinxingmaiming6409OP•6/9/25, 3:12 PM

Yyevgen I suspect that some of the metadata you insert has string with `U+2028` in it wi...

yinxingmaiming6409OP•6/9/25, 3:12 PM

Do you think my data is correct?

Original message was deleted

yinxingmaiming6409OP•6/9/25, 3:26 PM

I read an article saying that you want this format? Isn't ndjson this format?
I'll find you where the article is.

yinxingmaiming6409OP•6/9/25, 3:27 PM

yinxingmaiming6409OP•6/9/25, 3:27 PM

https://developers.cloudflare.com/vectorize/best-practices/insert-vectors/#examples

Cloudflare Docs

Insert vectors

yinxingmaiming6409OP•6/9/25, 3:28 PM

The file must be in newline-delimited JSON (NDJSON format): each complete vector must be newline separated, and not within an array or object.

Original message was deleted

yinxingmaiming6409OP•6/9/25, 3:30 PM

Because I only have one data and there is a line break at the end, right?

yinxingmaiming6409OP•6/9/25, 3:39 PM

I don't think there is any difference between me and the data format in the example. Can't you tell where the difference lies?

AAlex Graham You don't need to use NDJSON when you are using the SDKs (either in Python or No...

yinxingmaiming6409OP•6/10/25, 1:03 AM

I think he still needs a string type. How should I transmit it?

yinxingmaiming6409OP•6/10/25, 1:05 AM

yinxingmaiming6409OP•6/10/25, 1:05 AM

I feel like I misunderstood his comments. He only accepts str types

yinxingmaiming6409OP•6/10/25, 1:08 AM

The error has not changed,

yinxingmaiming6409OP•6/10/25, 1:34 AM

Has anyone really succeeded with SDK?

yinxingmaiming6409OP•6/10/25, 8:35 AM

Is billing based on the query vector dimension? Or the number of queries? For example, for my 512 dimensional vector, is querying once counted as 512?