You're using tokens correct? Not global API key?

IIsaac McFadyen You're using tokens correct? Not global API key?

BlockTxn•8/10/24, 2:19 PM

Not sure, I went to https://dash.cloudflare.com/profile/api-tokens
Created api key
Tested it with

curl -X GET "https://api.cloudflare.com/client/v4/user/tokens/verify" \
-H "Authorization: Bearer h1XXX" \
-H "Content-Type:application/json"

then followed on with the tutorials no problems but cannot delete, maybe i'm wrong

Yyevgen I'm happy to announce that all customers who requested access to Vectorize V2 ht...

DISPLAY NAME•8/13/24, 6:21 AM

do we need to fill this form to test V2 or need to subscribe a paid plan?

yevgen•8/14/24, 11:43 AM

Vectorize V2 is in public beta. As long as you have access to Vectorize and use the latest version of Wrangler https://github.com/cloudflare/workers-sdk/releases/tag/wrangler%403.71.0 you should have access to Vectorize V2.

GitHub

Release wrangler@3.71.0 · cloudflare/workers-sdk

Minor Changes

#6464 da9106c Thanks @AnantharamanSI! - feat: rename --count to --limit in wrangler d1 insights
This PR renames wrangler d1 insight's --count flag to --limit to improve clarity ...

BBlockTxn Not sure, I went to https://dash.cloudflare.com/profile/api-tokens Created api k...

garvitg•8/14/24, 3:09 PM

Hi @BlockTxn. Could you please confirm that the API Token you are using includes the Vectorize:Edit permission for the account in which this index is present? That permission would be needed to create or delete Vectorize indexes.

steyblind•8/15/24, 1:19 PM

Question about metadata indexing behavior: does it apply to existing vectors or only to those created after the metadata index is created? otherwise, does it backfill the index async?

steyblind•8/15/24, 1:28 PM

FYI, submitted API site feedback, https://developers.cloudflare.com/api/operations/vectorize-list-metadata-indexes should be GET not POST; also fails in

wrangler 3.71.0 when running $ wrangler vectorize list-metadata-index <index-name>$ wrangler vectorize list-metadata-index <index-name>

thipperz•8/18/24, 4:01 AM

there is something bad going on with vectorize indexes, I tried three times to create a text embeddings index, I defined them with metric cosine and 1536 dimensions. It appears that after inserting a certain amout of vectors my index breaks and my queries starting returning absolutely nonsense "scores" - for example right now my queries to this cosine index are returning scores like 28.955 or something like that (and that is breaking search results)

Saatvik•8/19/24, 3:21 AM

I don't see my vectorize v2 index in cloudflare dashboard. I only see v1 vector index. listing it with wrangler cli works

yigit•8/23/24, 12:57 PM

Hey Cloudflare team and community, I have a large dataset of 500M vectors500M vectors, each with 256 dimensions256 dimensions. I've recently seen the changelog about Vectorize v2 being in public beta, which mentions support for up to 5 million vector dimensions per index but there is not vector dimension limit mentioned on limits page? I'd like some clarification and advice on how to best use this with my dataset.

Limits: https://developers.cloudflare.com/vectorize/platform/limits/
Changelog: https://developers.cloudflare.com/vectorize/platform/changelog/

Given my vector dimensions (256) and the new limit of 5 million vector dimensions per index, my understanding is that I could potentially store up to 19,531 vectors per index (5,000,000 / 256 = 19,531.25). Is this correct?

If so, I would need approximately 25,600 indexes to store all 500M vectors (500,000,000 / 19,531 ≈ 25,600). However, this seems impractical given the current limit of 100 indexes per account.

My questions are:

1. Is my understanding of the "5 million vector dimensions" limit correct? Or does this mean something different? I wish to insert 5M vector for each index based on Limits page statement: Maximum vectors per index= 5MMaximum vectors per index= 5M
2. If my understanding is correct, what would be the best approach to handle such a large dataset with Vectorize? Given the current beta limit of 5 million vectors per index (on limits page, not changelog) I am proposing to distribute your data across 100 indexes, each containing 5 million vectors. My insertion strategy involves using a modulo operation to determine which index a vector should be inserted into. For querying, I plan to search all 100 indexes in parallel and then aggregate and rank the results.
3. Are there plans to increase the number of indexes allowed per account? If so wha tis maximum?

Any advice or insights would be greatly appreciated. Thank you!

Ssteyblind FYI, submitted API site feedback, https://developers.cloudflare.com/api/operatio...

Joey•8/23/24, 4:18 PM

I'm getting a similar error to this when trying to create meta-indexes

Joey•8/23/24, 4:19 PM

npx wrangler vectorize create-metadata-index <MYINDEX> --property-name='userId' --type='string'

npx wrangler vectorize create-metadata-index <MYINDEX> --property-name='userId' --type='string'

JJoey ```bash npx wrangler vectorize create-metadata-index <MYINDEX> --property-name='...

Joey•8/23/24, 4:20 PM

this is the command I ran

Joey•8/23/24, 4:20 PM

ERROR] A request to the Cloudflare API Failed
Expected request with

Content-Type: application/json

Content-Type: application/json

[code: 40026]

If you think this is a bug, please open an issue at:
https://github.com/cloudflare/workers-sdk/issues/new/choose

This is the output I'm getting

JJoey ```bash npx wrangler vectorize create-metadata-index <MYINDEX> --property-name='...

Joey•8/23/24, 4:21 PM

additionally the docs have this command with the name property and type property being wrapped in quotes on one page and not being wrapped in quotes on another

JJoey additionally the docs have this command with the name property and type property...

Joey•8/23/24, 4:21 PM

Both commands return the same error (I'm guessing its expecting a post request and using a get request)

Joey•8/23/24, 4:24 PM

Happens on both wrangler version: 3.72.0 and 3.72.2(latest)

garvitg•8/23/24, 4:33 PM

Hey @Joey. Thank you for reporting this! We are aware of this issue (https://github.com/cloudflare/workers-sdk/issues/6516) and we have pushed a fix. It should be available with the next release of Wrangler (expected early next week).

If you'd like to unblock yourself today, you can use a Wrangler pre-released version associated with this fix: https://github.com/cloudflare/workers-sdk/pull/6548#issuecomment-2302185968.

GitHub

🐛 BUG: Error when wrangler vectorize create-metadata-index on Vecto...

Which Cloudflare product(s) does this pertain to? Wrangler What version(s) of the tool(s) are you using? Wrangler 3.72.0 What version of Node are you using? 22.3.0 What operating system and version...

GitHub

fix: Fix Vectorize JSON payloads by garvit-gupta · Pull Request #65...

What this PR solves / how to test
Add content-type header to Vectorize POST operations
Fix Vectorize getVcetors, deleteVectors payload in Wrangler Client
Fixes #6516/VS-269 and VS-271.
Author has a...

Ggarvitg Hey <@488725208166039554>. Thank you for reporting this! We are aware of this is...

Joey•8/23/24, 4:46 PM

thank you very much, I must have missed the issue as I was looking through open issues before asking here

Joey•8/23/24, 4:47 PM

I'll use the pre-release version and fix it today thanks for the help

7437locked•8/28/24, 3:21 PM

hi cloudflare team, is vectorize still free for users with a workers paid plan?

the pricing page (https://developers.cloudflare.com/vectorize/platform/pricing/) says "Vectorize is currently in public beta and is free to use on Workers Paid plans." but also it says "We intend to enable billing for Vectorize usage in January 2024."

thanks

Cloudflare Docs

Pricing | Vectorize

Vectorize bills based on:

kcbrewron•8/28/24, 4:40 PM

As I move from a proof of concept to a real application product,is there a way to migrate the data or rename an existing vector index? It would be very handy to be able to do this in the wrangler cli

77437locked hi cloudflare team, is vectorize still free for users with a workers paid plan? ...

yevgen•8/30/24, 4:05 PM

it still free to use, but we intend to enable billing next month.

EEduardo Hello, I can create Vectorize index with the wrangler cli (and list them) but th...

DaniFoldi•8/31/24, 8:54 AM

I can repro - seems like the dash only lists old (v1) indexes and not v2. I've let the team know so hopefully they'll look into this next week. Until then you can use wrangler vectorize listwrangler vectorize list to see your v2 indexes

C J•9/3/24, 10:15 AM

The v2 docs indicate that querying indexed metadata can truncate long text values. I understand not wanting to define the exact value in the API, although is there a guideline for this truncation threshold? I would like to store the original text associated with the vector. In my use case, these text values are generally a few hundred words or less.

CC J The v2 docs indicate that querying indexed metadata can truncate long text value...

Jerome•9/3/24, 2:42 PM

You can store up to 10KiB of metadata per vector; vectorize will either accept the data if it fits, or reject the upsert if not. The truncation happens in the metadata index at 64B, meaning you can filter indexed metadata properties on their first 64B. The original vector metadata is never truncated, and can be obtained verbatim on vector query by specifying the "metadata": "all""metadata": "all" option.

JJerome You can store up to 10KiB of metadata per vector; vectorize will either accept t...

C J•9/3/24, 5:21 PM

Thank you for those details. That’s really helpful. So basically ~64 ASCII characters before truncation when using indexed metadata?

The challenge with metadata: all option for me is that it limits to topK 20 results. I’m hoping to return closer to 40 results, as I do a rerank and then trim the set before presenting to the LLM. Metadata: indexed would let me return topK 100 but the truncation cutoff makes it less useful.

Is the topK max of 20 anticipated to improve in the future with metadata: all? Otherwise I will need to completely re-architect and store metadata independently of vectors.

maro•9/3/24, 8:38 PM

Hey guys! I'm aware that Vectorize is currently in beta, but I'm curious about its reliability for production use. My specific use case involves a chatbot that serves approximately 1 million users per month. If Vectorize isn't suitable, could you recommend any other alternatives? Pinecone? pgvector?

scotto•9/4/24, 1:52 AM

Any plans to support arrays in metadata filtering ?

hannojg•9/5/24, 8:46 PM

Hey, quick question: its expected that on the web dashboard you don't see any of the vector indexes you've created (while in wrangler you do) ?

hannojg•9/5/24, 8:47 PM

ah that has already been answered here How can I bind it to a project without thanks!

hannojg•9/5/24, 8:49 PM

~~Is there a limit to how many vector indexes we can create?~~
Edit: found the limits docs, all good

Mmaro Hey guys! I'm aware that Vectorize is currently in beta, but I'm curious about i...

yevgen•9/6/24, 12:49 PM

@maro Vectorize is ready for production use, we are planning to transition out of beta soon.

Yyevgen @maro Vectorize is ready for production use, we are planning to transition out o...

hannojg•9/6/24, 12:57 PM

Cool! Are there any early details on how the limits will increase?

ac•9/6/24, 1:09 PM

Is there any way to upgrade a v1 Vectorize index to v2, or do I need to create a completely new one?

Original message was deleted

Isaac McFadyenOP•9/6/24, 9:41 PM

TIL that you can link a slash command in a message

Hhannojg Cool! Are there any early details on how the limits will increase? 😊

yevgen•9/7/24, 9:38 AM

So far we haven't observed anyone using Vectorize to encounter our current limits, what exactly you have in mind?

Yyevgen So far we haven't observed anyone using Vectorize to encounter our current limit...

cloudkite•9/7/24, 8:57 PM

Would love to be able to dynamically create & bind an index per customer/tenant. Is that something that’s on the roadmap?

Yyevgen So far we haven't observed anyone using Vectorize to encounter our current limit...

hannojg•9/8/24, 1:24 AM

In our use case we don’t have a lot of data belonging to one category, but a lot of smaller data belonging to many segments.
So I am wondering how I can segment the vectors. The options I see are:
- creating an index per segment
- using namespaces in the same index
- metadata filtering (less preferred)

Both indexes and namespaces have quite a tight limit for our use case

Ccloudkite Would love to be able to dynamically create & bind an index per customer/tenant....

hannojg•9/8/24, 1:27 AM

Kind of like this - if we already have 20.000 customers, and each customer has ~15 projects for which I’d need separate segments, it’s hard to do that with the current limits

yevgen•9/9/24, 8:45 AM

I think metadata filtering is the best way forward. If you prefer using namespace for whaterever reason (nothing special other then we index it by default) we can lift # of namespaces limit for your account.

yevgen•9/9/24, 8:48 AM

Creating an index per segment could be an option as long as your index size will be at least 50k vectors, otherwise one index for all data is probably a better match.

You're using tokens correct? Not global API key?

Similar Threads

Similar Threads

Similar Threads