Hey everyone, I’ve been exploring
Hey everyone, I’ve been exploring Vectorize for my product in a multi-tenant setup where each tenant gets their own index chunk via namespaces. Because of the worker binding count limit (and lack of dynamic creation), I went with the REST API approach.
But I recently discovered that Cloudflare rate limits HTTP requests (1,000 per 5 minutes), which makes me wonder how Vectorize is supposed to be used effectively in a multi-tenant setup.
I’m confused because Cloudflare advertises 50k indexes per account, but in practice this doesn’t seem possible due to the worker binding limit + request rate limits. Feeling a bit stuck and frustrated—what’s the recommended approach here?
3 Replies
Hey @vijay. Thank you for reaching out.
We understand your concern. Since dynamic bindings are not available for Vectorize yet, we may be able to recommend a workaround.
We recently made some operational improvements to Vectorize. And Vectorize queries, upserts/inserts and getByIds operations no longer fall under the standard Cloudflare rate-limit (1200 requests per 5 minutes for an account).
I hope that should help you use it effectively in a multi-tenant setup.
Thank you so much. It saved me a huge amount of engineering effort. I’m genuinely happy about this.
Hey @garvit , could you please help me with a couple of questions?
1. Will Cloudflare increase the index limit (50k per account) if I’m approaching the cap? If not, would it be possible to use Vectorize from multiple Cloudflare accounts?
2. When querying vectors, are charges based on the total number of vectors stored in the index, or only the vectors scoped by the namespace filter?
1. We can review the index per account limit if you're sure you are going to exceed it. That being said, it's certainly possible to create multiple accounts and use Vectorize from each.
2. The vector count component in the queried vector dimensions includes the total number of vectors in the index. Metadata or namespace filtering has no impact on the computation of queried vector dimensions.