See https://js.langchain.com/docs/integrations/text_embedding/cloudflare_ai

M

import { CloudflareVectorizeStore } from "langchain/vectorstores/cloudflare_vectorize";

import { CloudflareVectorizeStore } from "langchain/vectorstores/cloudflare_vectorize";

import { CloudflareVectorizeStore } from "langchain/vectorstores/cloudflare_vectorize";

import { CloudflareVectorizeStore } from "langchain/vectorstores/cloudflare_vectorize";

M

Matt SilverlockOP•12/4/23, 2:28 PM

and https://js.langchain.com/docs/integrations/vectorstores/cloudflare_vectorize

Cloudflare Vectorize | 🦜️🔗 Langchain

If you're deploying your project in a Cloudflare worker, you can use Cloudflare Vectorize with LangChain.js.

MMatt Silverlock See https://js.langchain.com/docs/integrations/text_embedding/cloudflare_ai

D

dave•12/4/23, 2:28 PM

Oh I know, I just want it to use Vectorize in Python too!

M

Matt SilverlockOP•12/4/23, 2:29 PM

Ah, sorry, misread. You should contribute it

U

umair mehmood•12/5/23, 9:47 AM

I am getting this when creating vector index from API
Payload

{
  "config": {
    "preset": "@cf/baai/bge-small-en-v1.5",
    "dimensions": 768,
    "metric": "cosine"

  },
  "description": "This is my example index.",
  "name": "example-index"
}

{
  "config": {
    "preset": "@cf/baai/bge-small-en-v1.5",
    "dimensions": 768,
    "metric": "cosine"

  },
  "description": "This is my example index.",
  "name": "example-index"
}

{
  "config": {
    "preset": "@cf/baai/bge-small-en-v1.5",
    "dimensions": 768,
    "metric": "cosine"

  },
  "description": "This is my example index.",
  "name": "example-index"
}

{
  "config": {
    "preset": "@cf/baai/bge-small-en-v1.5",
    "dimensions": 768,
    "metric": "cosine"

  },
  "description": "This is my example index.",
  "name": "example-index"
}

response

{
    "result": null,
    "success": false,
    "errors": [
        {
            "code": 1005,
            "message": "vectorize.not_entitled"
        }
    ],
    "messages": []
}

{
    "result": null,
    "success": false,
    "errors": [
        {
            "code": 1005,
            "message": "vectorize.not_entitled"
        }
    ],
    "messages": []
}

{
    "result": null,
    "success": false,
    "errors": [
        {
            "code": 1005,
            "message": "vectorize.not_entitled"
        }
    ],
    "messages": []
}

{
    "result": null,
    "success": false,
    "errors": [
        {
            "code": 1005,
            "message": "vectorize.not_entitled"
        }
    ],
    "messages": []
}

K

kian•12/5/23, 9:50 AM

Does that account have a Workers Paid plan?

U

umair mehmood•12/5/23, 9:56 AM

No

U

umair mehmood•12/5/23, 9:57 AM

I see now its avilable on paid plan only.

U

umair mehmood•12/5/23, 9:58 AM

btw from where I can get the

account_identifier

account_identifier

account_identifier

account_identifier?

K

kian•12/5/23, 10:15 AM

https://developers.cloudflare.com/fundamentals/setup/find-account-and-zone-ids/

Find zone and account IDs · Cloudflare Fundamentals docs

Once you set up a new account and add your domain to Cloudflare, you may need access to your zone and account IDs for API operations.

K

kian•12/5/23, 10:16 AM

It'll be in the URL when you're on the dashboard, but otherwise you can find it on the sidebar as the docs say.

Ccfnathan There is currently a bug with this: fix is here - https://github.com/cloudflare/...

S

steyblind•12/5/23, 2:14 PM

this is fixed, but awaiting release, is that correct?

V

Vy•12/6/23, 5:53 PM

Hi folks, it's a fun day because metadata filtering is now available with Vectorize! Check out the docs here, https://developers.cloudflare.com/vectorize/learning/metadata-filtering/. Happy building and please share any feedback or issues!

Metadata filtering · Vectorize

In addition to providing an input vector to your query, you can also filter by vector metadata associated with every vector. Query results only …

VVy Hi folks, it's a fun day because metadata filtering is now available with Vector...

S

scotto•12/7/23, 12:12 AM

awesome! namespace filtering is before than metadata filtering?

Sscotto awesome! namespace filtering is before than metadata filtering?

J

Jerome•12/7/23, 9:33 AM

yes, but it shouldn't matter regarding the set of vectors in the response, as the intersection of both match sets is what's taken into consideration when results are evaluated

JJerome yes, but it shouldn't matter regarding the set of vectors in the response, as th...

S

scotto•12/7/23, 11:41 AM

perfect, re performance is the same for namespace filtering and metadata filtering ?

Sscotto perfect, re performance is the same for namespace filtering and metadata filteri...

J

Jerome•12/7/23, 12:46 PM

no, namespace filtering is generally faster than metadata filtering

O

Old Man Maker•12/7/23, 4:02 PM

refreshing my memory here - we're still looking at 1000 namespaces max per account?

OOld Man Maker refreshing my memory here - we're still looking at 1000 namespaces max per accou...

J

Jerome•12/7/23, 4:24 PM

yep; https://developers.cloudflare.com/vectorize/platform/limits/

OOld Man Maker refreshing my memory here - we're still looking at 1000 namespaces max per accou...

M

Matt SilverlockOP•12/7/23, 7:37 PM

Per index

F

Frank•12/7/23, 8:01 PM

whats the expected error when we exceed # of vec, namespace per index

F

Frank•12/7/23, 10:59 PM

hopfully the hard limit on namespace will be lifted post beta

채

채찬•12/8/23, 2:55 AM

After connecting to Vectorize, there is no results data when requesting a D1 query.
Previously, it worked fine.
In the dashboard, the number of query requests is increasing.
Probably a bug.

MMatt Silverlock Per _index_

O

Old Man Maker•12/8/23, 4:58 AM

Yep, the per index part is important

BBhanu Teja P Awesome. How to request an increase in limits. Right now, it shows 200k vectors ...

V

Vy•12/8/23, 3:29 PM

With open beta product today, we can't support that large of an index. However, it's something we're working on! Are you often (1) searching across all 5M vectors or (2) search space is smaller but used to operating a single index?

H

huw•12/11/23, 11:51 PM

Hello! Is there a limit on the maximum number of IDs for

getByIds

getByIds

getByIds

getByIds and

deleteByIds

deleteByIds

deleteByIds

deleteByIds? I am scheduling a bulk delete and want to know if I should chunk it, or if that limit is well above the memory size of a Worker. (EDIT for searchers: Limit is 20)

Workers API · Vectorize

This page covers the Vectorize API available within Cloudflare Workers, including usage examples.

BBhanu Teja P We have a single index and the vectors of all my customers would go to that sing...

Y

yevgen•12/12/23, 11:08 AM

Hi Bhanu, Eng manager here. Based on the info you provided I suggest splitting your 5M vectors index into smaller indexes per customer id. Let me know if 100 indexes per account is sufficient for you (we can bump this limit if necessary). You will get much better performance searching in smaller indexes. We are working hard to bump vectors per index limit, we don't have ETA for this to be ready though.

BBhanu Teja P I will rather wait for sometime until Vectorize becomes stable enough to handle ...

Y

yevgen•12/12/23, 11:36 AM

fair enough

Yyevgen Hi Bhanu, Eng manager here. Based on the info you provided I suggest splitting y...

H

huw•12/12/23, 11:15 PM

This would also be more reasonable if there was a way to programatically create Workers bindings for indices, but you have to use

wrangler.toml

wrangler.toml

wrangler.toml

wrangler.toml right now which hard-codes your limit

H

huw•12/12/23, 11:16 PM

I’m not sure about the specifics—you can use API calls to create and query indices dynamically, sure, but aren’t those API calls slower?

Hhuw Hello! Is there a limit on the maximum number of IDs for [`getByIds` and `delete...

H

huw•12/13/23, 9:41 AM

(I have found out that this limit is 20)

D

divby0•12/13/23, 12:19 PM

Are pages bindings here yet? The API doesn't support delete so I can't really use it. Gotta wait for pages bindings :/

S

scotto•12/13/23, 8:32 PM

hey - we started to get a strange 502 error from search API -

Ccfnathan checking into this for you 👀

S

scotto•12/13/23, 8:45 PM

https://api.cloudflare.com/client/v4/accounts/920b1a6e159cf77dab28969103a4765b/vectorize/indexes/customers-650a02c2a5be79517a7f79e2/query

https://api.cloudflare.com/client/v4/accounts/920b1a6e159cf77dab28969103a4765b/vectorize/indexes/customers-650a02c2a5be79517a7f79e2/query

https://api.cloudflare.com/client/v4/accounts/920b1a6e159cf77dab28969103a4765b/vectorize/indexes/customers-650a02c2a5be79517a7f79e2/query

https://api.cloudflare.com/client/v4/accounts/920b1a6e159cf77dab28969103a4765b/vectorize/indexes/customers-650a02c2a5be79517a7f79e2/query

X

xeon06•12/14/23, 12:48 AM

Hey folks, love the work on the AI stuff! Just wanted to drop in to chime in that I would love it for the limits on Vectorize index to be way higher, to the tune of a couple of indices per user of my app. That's all!

Xxeon06 Hey folks, love the work on the AI stuff! Just wanted to drop in to chime in tha...

J

Jerome•12/14/23, 9:46 AM

for survey purposes, what limit would fit your use case?

JJerome for survey purposes, what limit would fit your use case?

X

xeon06•12/14/23, 8:56 PM

I don't want to give a number because it would scale with the number of users my app has, e.g. I need to be able to make vector searches against documents belonging only to a single user.

Even if it was 10,000, then what do I do at 10k users!

X

xeon06•12/14/23, 9:00 PM

There's a world where I can filter post search, but that doesn't seem inefficient and probably severely limited by the

topK

topK

topK

topK limit

Xxeon06 There's a world where I can filter post search, but that doesn't seem inefficien...

H

huw•12/14/23, 11:59 PM

The in between here is namespaces, right now if you maximally used indices & namespaces you could support 100k users

H

huw•12/15/23, 12:00 AM

tbh it’s not really clear whether a user-segmented app is supposed to use separate indices or separate namespaces right now—only except that namespaces have the advantage of using proper service bindings but if you go for

n

n indices you’d have to use the API

X

xeon06•12/15/23, 1:13 AM

Oh wow somehow I completely missed namespaces

X

xeon06•12/15/23, 1:14 AM

Yeah I suppose without creating new indices with the API in order to "bin" the namespaces you're limited at 1000

See https://js.langchain.com/docs/integrations/text_embedding/cloudflare_ai

Similar Threads