Vectorize is not available for local development ? - Cloudflare Developers

© 2026 Hedgehog Software, LLC

More

Communities Docs About Terms Privacy

Vinodh

VVinodh Vectorize is not available for local development ?

Vero

V

Vero•7/1/24, 8:37 AM

It's not supported yet

cosbgn

Ccosbgn One of my biggest concerns is 1K namespaces, if I want to add a namespace for ea...

ulysses

U

ulysses•7/2/24, 1:48 AM

I have this question as well–what can we expect the limits to be?

thipperz

T

thipperz•7/3/24, 5:29 PM

Please Vectorize V2 come soon

thipperz

T

thipperz•7/3/24, 5:30 PM

my main concern is the topK

yevgen

Yyevgen We are focusing to start onboarding first customers on new version of Vectorize ...

Derpenstein69

D

Derpenstein69•7/4/24, 7:58 PM

Please add me to the list, thank you

yevgen

Yyevgen We are focusing to start onboarding first customers on new version of Vectorize ...

kingmesal

K

kingmesal•7/6/24, 6:52 PM

I'd like in.

Bierman

B

Bierman•7/9/24, 2:02 PM

Is there a rough ETA on being able to run vectorize locally?

For context: I have a worker using a lot of cf services and it seems I have to use the api for vectorize as the —remote flag points all services to remote dev when really my goal is to run as many services locally as possible, then use remote for the unsupported ones. Is there a better way to handle this?

pdwittig

Ppdwittig Hey all 👋 - New product launch - Vectorize V2 In the next week or two, we'll s...

Fokke

F

Fokke•7/9/24, 4:36 PM

Are you also increasing the number of vectors in an index or just the number of indexes? I am working on a use case where we need something close to 20-40MM vectors. We could store those all over multiple indexes, but a single index would be much preferred.

Or do you perhaps mean the number of vectors per index is increased to 2MM and the number of indexes stays the same?

pdwittig

Ppdwittig Hey all 👋 - New product launch - Vectorize V2 In the next week or two, we'll s...

yigit

Y

yigit•7/9/24, 6:28 PM

hey @pdwittig we have a unique case with 500m docs but each of them are 256 dimensions. do you think that we can try vectorize v2 for our usecase?

leesus

L

leesus•7/12/24, 12:46 PM

Is there any page/documentation around Vectorize error codes?

leesus

L

leesus•7/12/24, 12:47 PM

Am seeing a handful of upsert/delete/query errors in sentry with codes 2006 and 2008 and "internal server error" messaging but struggling to find any indication of what the actual issue is

Maltmax

M

Maltmax•7/14/24, 3:49 PM

Hi! I don't suppose there is a way to get all vectors stored in a vectorize database without knowing the vector IDs, right?

akazwz

A

akazwz•7/16/24, 3:09 PM

@pdwittig hello team. my account id is a275d70ec37a6046e6778c77d65dd38b. and i have problems in dashboard vectorize. it is empty now.

Idle

I

Idle•7/17/24, 10:56 AM

?pings

Flare

F

Flare•7/17/24, 10:56 AM

Please do not ping community members for non-moderation reasons. Doing so will not solve your issue faster and will make people less likely to want to help you.

SteffTek

S

SteffTek•7/18/24, 7:48 AM

vectorize ui not loading :pain:

SteffTek

S

SteffTek•7/18/24, 7:48 AM

akazwz

A

akazwz•7/19/24, 3:50 AM

me too

yigit

Y

yigit•7/20/24, 12:25 AM

Is there anyone with access to vectorize v2? I'm eagerly waiting.

Zeeshan

Z

Zeeshan•7/24/24, 4:22 PM

Hi folks, just to confirm here once again, if i want to convert data in my d1 db to vectors, i can reach out to vectorise right? and it is paid right?

zensin

Z

zensin•7/26/24, 2:08 AM

I keep putting off part of a project hoping this will come out of beta. hows she lookin?

zensin

Zzensin I keep putting off part of a project hoping this will come out of beta. hows she...

DaniFoldi

D

DaniFoldi•7/26/24, 11:43 AM

:soontm: is the most accurate answer you'll probably get

yevgen

Y

yevgen•7/31/24, 5:58 PM

I'm happy to announce that all customers who requested access to Vectorize V2 https://forms.gle/jtSJAqz478DsULN86 have been onboarded.

Google Docs

Vectorize V2 - Waitlist

In the next week or two, we'll start rolling out the next generation of Vectorize, which has been completely re-architected from the ground up. This new version supports 2M+ vector indexes, delivers significantly improved query latency, and much more.

Over the coming weeks, we'll be gradually inviting new teams to onboard. If you're interested ...

Vectorize V2 - Waitlist

LordQ

L

LordQ•8/1/24, 2:05 PM

Can we expect a visualisation window for Cloudflare Vectorize to manage or monitor our embedding data? Like what we can use in D1 Database

yevgen

Yyevgen I'm happy to announce that all customers who requested access to Vectorize V2 ht...

zwily

Z

zwily•8/3/24, 1:38 PM

I’m 90% sure i filled out the form when you posted it, and never got an email. I just filled it out again.

zwily

Zzwily I’m 90% sure i filled out the form when you posted it, and never got an email. I...

Victor

V

Victor•8/3/24, 3:15 PM

I didn't get an email other, but if you hit the /V2 API endpoint either they'll work or you'll get a 403 operation forbidden

Victor

VVictor I didn't get an email other, but if you hit the /V2 API endpoint either they'll ...

zwily

Z

zwily•8/3/24, 3:16 PM

Where is the documentation?

zwily

Zzwily Where is the documentation?

Victor

V

Victor•8/3/24, 3:17 PM

https://developers.cloudflare.com/api/operations/vectorize-list-vectorize-indexes

Cloudflare API Documentation

Interact with Cloudflare's products and services via the Cloudflare API

thipperz

T

thipperz•8/5/24, 11:34 PM

Hi there,

I filled out the form but I'm getting vectorize.operation_forbidden [code: 1011]vectorize.operation_forbidden [code: 1011] when trying to create a V2 index. I've installed the required Wrangler prerelease version.

The full message also includes

✘ [ERROR] A request to the Cloudflare API (/accounts/***/vectorize/v2/indexes) failed.✘ [ERROR] A request to the Cloudflare API (/accounts/***/vectorize/v2/indexes) failed.

BlockTxn

B

BlockTxn•8/10/24, 2:15 PM

I'm trying to delete an index, i can confirm that the token and account id are 100% correct, followed the doc yet

  curl --request DELETE \
  --url https://api.cloudflare.com/client/v4/accounts/c9XXXXXXXXXX/vectorize/v2/indexes/vector-index \
  --header 'Authorization: Bearer h1IXXXXXXXXX' \
  --header 'Content-Type: application/json'

  curl --request DELETE \
  --url https://api.cloudflare.com/client/v4/accounts/c9XXXXXXXXXX/vectorize/v2/indexes/vector-index \
  --header 'Authorization: Bearer h1IXXXXXXXXX' \
  --header 'Content-Type: application/json'

got

{"success":false,"errors":[{"code":10000,"message":"Authentication error"}]}

{"success":false,"errors":[{"code":10000,"message":"Authentication error"}]}

any ideas ? thanks

BlockTxn

BBlockTxn I'm trying to delete an index, i can confirm that the token and account id are 1...

Isaac McFadyen

I

Isaac McFadyen•8/10/24, 2:17 PM

You're using tokens correct? Not global API key?

Isaac McFadyen

IIsaac McFadyen You're using tokens correct? Not global API key?

BlockTxn

B

BlockTxn•8/10/24, 2:19 PM

Not sure, I went to https://dash.cloudflare.com/profile/api-tokens
Created api key
Tested it with

curl -X GET "https://api.cloudflare.com/client/v4/user/tokens/verify" \
-H "Authorization: Bearer h1XXX" \
-H "Content-Type:application/json"

then followed on with the tutorials no problems but cannot delete, maybe i'm wrong

yevgen

Yyevgen I'm happy to announce that all customers who requested access to Vectorize V2 ht...

DISPLAY NAME

D

DISPLAY NAME•8/13/24, 6:21 AM

do we need to fill this form to test V2 or need to subscribe a paid plan?

yevgen

Y

yevgen•8/14/24, 11:43 AM

Vectorize V2 is in public beta. As long as you have access to Vectorize and use the latest version of Wrangler https://github.com/cloudflare/workers-sdk/releases/tag/wrangler%403.71.0 you should have access to Vectorize V2.

GitHub

Release wrangler@3.71.0 · cloudflare/workers-sdk

Minor Changes

#6464 da9106c Thanks @AnantharamanSI! - feat: rename --count to --limit in wrangler d1 insights
This PR renames wrangler d1 insight's --count flag to --limit to improve clarity ...

Release wrangler@3.71.0 · cloudflare/workers-sdk

BlockTxn

BBlockTxn Not sure, I went to https://dash.cloudflare.com/profile/api-tokens Created api k...

garvitg

G

garvitg•8/14/24, 3:09 PM

Hi @BlockTxn. Could you please confirm that the API Token you are using includes the Vectorize:Edit permission for the account in which this index is present? That permission would be needed to create or delete Vectorize indexes.

steyblind

S

steyblind•8/15/24, 1:19 PM

Question about metadata indexing behavior: does it apply to existing vectors or only to those created after the metadata index is created? otherwise, does it backfill the index async?

steyblind

S

steyblind•8/15/24, 1:28 PM

FYI, submitted API site feedback, https://developers.cloudflare.com/api/operations/vectorize-list-metadata-indexes should be GET not POST; also fails in

wrangler 3.71.0 when running $ wrangler vectorize list-metadata-index <index-name>$ wrangler vectorize list-metadata-index <index-name>

thipperz

T

thipperz•8/18/24, 4:01 AM

there is something bad going on with vectorize indexes, I tried three times to create a text embeddings index, I defined them with metric cosine and 1536 dimensions. It appears that after inserting a certain amout of vectors my index breaks and my queries starting returning absolutely nonsense "scores" - for example right now my queries to this cosine index are returning scores like 28.955 or something like that (and that is breaking search results)

Saatvik

S

Saatvik•8/19/24, 3:21 AM

I don't see my vectorize v2 index in cloudflare dashboard. I only see v1 vector index. listing it with wrangler cli works

yigit

Y

yigit•8/23/24, 12:57 PM

Hey Cloudflare team and community, I have a large dataset of 500M vectors500M vectors, each with 256 dimensions256 dimensions. I've recently seen the changelog about Vectorize v2 being in public beta, which mentions support for up to 5 million vector dimensions per index but there is not vector dimension limit mentioned on limits page? I'd like some clarification and advice on how to best use this with my dataset.

Limits: https://developers.cloudflare.com/vectorize/platform/limits/
Changelog: https://developers.cloudflare.com/vectorize/platform/changelog/

Given my vector dimensions (256) and the new limit of 5 million vector dimensions per index, my understanding is that I could potentially store up to 19,531 vectors per index (5,000,000 / 256 = 19,531.25). Is this correct?

If so, I would need approximately 25,600 indexes to store all 500M vectors (500,000,000 / 19,531 ≈ 25,600). However, this seems impractical given the current limit of 100 indexes per account.

My questions are:

1. Is my understanding of the "5 million vector dimensions" limit correct? Or does this mean something different? I wish to insert 5M vector for each index based on Limits page statement: Maximum vectors per index= 5MMaximum vectors per index= 5M
2. If my understanding is correct, what would be the best approach to handle such a large dataset with Vectorize? Given the current beta limit of 5 million vectors per index (on limits page, not changelog) I am proposing to distribute your data across 100 indexes, each containing 5 million vectors. My insertion strategy involves using a modulo operation to determine which index a vector should be inserted into. For querying, I plan to search all 100 indexes in parallel and then aggregate and rank the results.
3. Are there plans to increase the number of indexes allowed per account? If so wha tis maximum?

Any advice or insights would be greatly appreciated. Thank you!

steyblind

Ssteyblind FYI, submitted API site feedback, https://developers.cloudflare.com/api/operatio...

Joey

J

Joey•8/23/24, 4:18 PM

I'm getting a similar error to this when trying to create meta-indexes

Joey

J

Joey•8/23/24, 4:19 PM

npx wrangler vectorize create-metadata-index <MYINDEX> --property-name='userId' --type='string'

npx wrangler vectorize create-metadata-index <MYINDEX> --property-name='userId' --type='string'

Joey

JJoey ```bash npx wrangler vectorize create-metadata-index <MYINDEX> --property-name='...

Joey

J

Joey•8/23/24, 4:20 PM

this is the command I ran

Joey

J

Joey•8/23/24, 4:20 PM

ERROR] A request to the Cloudflare API Failed
Expected request with Content-Type: application/jsonContent-Type: application/json [code: 40026]

If you think this is a bug, please open an issue at:
https://github.com/cloudflare/workers-sdk/issues/new/choose

This is the output I'm getting

Joey

JJoey ```bash npx wrangler vectorize create-metadata-index <MYINDEX> --property-name='...

Joey

J

Joey•8/23/24, 4:21 PM

additionally the docs have this command with the name property and type property being wrapped in quotes on one page and not being wrapped in quotes on another

  curl --request DELETE \
  --url https://api.cloudflare.com/client/v4/accounts/c9XXXXXXXXXX/vectorize/v2/indexes/vector-index \
  --header 'Authorization: Bearer h1IXXXXXXXXX' \
  --header 'Content-Type: application/json'

  curl --request DELETE \
  --url https://api.cloudflare.com/client/v4/accounts/c9XXXXXXXXXX/vectorize/v2/indexes/vector-index \
  --header 'Authorization: Bearer h1IXXXXXXXXX' \
  --header 'Content-Type: application/json'