Hey, has there been any considerations for having the Workers option be limited to storage in the EU

MMSL Hey, has there been any considerations for having the Workers option be limited ...

V

Viktor•5/21/25, 9:08 AM

Cloudflare is certified by eu us data privacy framework, it is GDPR compliant. But for some storage options (like R2, D1) you can already set a region. You posted this question in workers-ai and asked about storage - do you mean specifically vectorize?

VViktor Cloudflare is certified by eu us data privacy framework, it is GDPR compliant. B...

M

MSLOP•5/21/25, 9:36 AM

No, I am specifically talking about Workers, since they run on all network locations that can potentially be a GDPR issue for data handling,
It’s not as easy as them being certified, if a worker parses sensitive data but is hosted outside of the EU that can be an issue even with the Cloudflare DPA should cover it, it depends on the data you’re handling

M

MSLOP•5/21/25, 9:43 AM

Searching for it also shows people arguing and general confusion regarding the DPA with no official reply from Cloudflare except “You can sign a DPA with us” but Pages and Workers are specifically written to not be an option to have Data Localization only in the EU. Which is where I doubt the management of GDPR is sufficient, as the processor I would still be the one with fines if some data is processed outside of the EU

M

Mochni•5/21/25, 11:54 PM

Hi

M

Mochni•5/21/25, 11:55 PM

It says I used 691.2/10k neurons, but the chart says I used 16.93k neurons

M

Mochni•5/21/25, 11:55 PM

What am I missing here?

O

Object•5/23/25, 9:24 PM

Hello, reporting an issue with Gemma 3 in Workers AI, or maybe just the documentation about it.

The Gemma 3 model is not behaving as documented. Two issues so far:

(minor but a bit annoying) "@cf/google/gemma-3-12b-it" is not included in
```
wrangler types
```
```
wrangler types
```
the following code chokes, even though correct per the official doc page (https://developers.cloudflare.com/workers-ai/models/gemma-3-12b-it/) . The part it dislikes is
```
messages[1].content
```
messages[1].content
```
messages[1].content
```
messages[1].content
being an object instead of string. The string format only works for text, however, not image, i.e.
```
{role: 'user', content: dataUri}
```
{role: 'user', content: dataUri}
```
{role: 'user', content: dataUri}
```
{role: 'user', content: dataUri}
will not choke but Gemma will completely hallucinate the actual content of the image, while recognizing the same image just fine if uploaded in aistudio.google.com.

const res = await fetch(

https://cataas.com/cat

https://cataas.com/cat

https://cataas.com/cat

https://cataas.com/cat);
const blob = await res.arrayBuffer();
const imageData = [...new Uint8Array(blob)];

const base64 = btoa(String.fromCharCode(...imageData));
const dataUri =

data:image/jpeg;base64,${base64}

data:image/jpeg;base64,${base64}

data:image/jpeg;base64,${base64}

data:image/jpeg;base64,${base64};

const response = await env.AI.run(
"@cf/google/gemma-3-12b-it",
{
messages: [
{role: 'system', content: 'describe uploaded images'},
{role: 'user',
content: {
type: 'image', // tried with and without this line
image_url: {url: dataUri}
}
}
]
}).catch(e => {
console.error(

AI.run error

AI.run error

AI.run error

AI.run error, e);
throw e;
});

return new Response(JSON.stringify(response), {
headers: [['content-type', 'application/json']]
});

O

Object•5/23/25, 9:28 PM

Here is the error the run API returns:
✘ [ERROR] AI error InferenceUpstreamError [AiError]: 3030: 3 validation errors for ValidatorIterator

0.typed-dict
Input should be a valid dictionary [type=dict_type, input_value='image_url', input_type=str]
For further information visit https://errors.pydantic.dev/2.10/v/dict_type
0.typed-dict
Input should be a valid dictionary [type=dict_type, input_value='image_url', input_type=str]
For further information visit https://errors.pydantic.dev/2.10/v/dict_type
0.typed-dict
Input should be a valid dictionary [type=dict_type, input_value='image_url', input_type=str]
For further information visit https://errors.pydantic.dev/2.10/v/dict_type
at Ai._parseError (cloudflare-internal:ai-api:102:24)
at async Ai.run (cloudflare-internal:ai-api:82:19)
at response (file:///<...>/classify.ts:58:20)
at async Object.fetch
(file:///<...>node_modules/src/src/Router.ts:58:20)
at async jsonError
(file:///<...>/node_modules/wrangler/templates/middleware/middleware-miniflare3-json-error.ts:22:10)
at async drainBody
(file:///<...>node_modules/wrangler/templates/middleware/middleware-ensure-req-body-drained.ts:5:10)

S

SODaLC•5/25/25, 2:59 PM

Im current running into an error about "JSON Model couldn't be met" . Is there a way to tell why this is happening or what it is having trouble with with some sort of verbose mode? At the moment, it very inconsistent.

Z

zensin•5/27/25, 4:07 AM

Please add Devstral-Small-2505 if possible
https://huggingface.co/mistralai/Devstral-Small-2505
https://huggingface.co/unsloth/Devstral-Small-2505

D

Dev•5/27/25, 5:02 AM

Hi, why can't we use BGE-M3 embedding model (@cf/baai/bge-m3) to create vector index?

Only these model are available to choose from: [ "@cf/baai/bge-small-en-v1.5", "@cf/baai/bge-base-en-v1.5", "@cf/baai/bge-large-en-v1.5", "openai/text-embedding-ada-002", "cohere/embed-multilingual-v2.0" ]

E

eli-front•5/27/25, 11:16 PM

Has anyone successfully setup tool call streaming with any of the function calling models? I can get tool calling to work when it's not streaming.

DDev Hi, why can't we use BGE-M3 embedding model (@cf/baai/bge-m3) to create vector i...

V

Viktor•5/28/25, 10:46 AM

I have no idea what you mean, but you can create a vector index with length = 1024 via wrangler, and store vectors created via bge-m3 in it

Eeli-front Has anyone successfully setup tool call streaming with any of the function calli...

V

Viktor•5/28/25, 10:49 AM

I buffered the first bytes and checked if they contain json or xml (depending on the model). If it does not start with

{"

{"

{"

{" or

<function

<function

<function

<function (it was I think) it's not a function call, else it is one. In theory @cloudflare/ai-utils can do that, but it calls the model twice (once without streaming and in case it does not call a tool - again with streaming), so I didn't want to use it

GitHub

GitHub - cloudflare/ai-utils: Developer toolkit that makes it simpl...

Developer toolkit that makes it simple to build with the Workers AI platform. - cloudflare/ai-utils

P

plgingras88•5/29/25, 2:09 AM

Using toMarkdown on a jpeg in my R2 bucket right now returns AiError: 3043: Internal server error. I changed nothing and was working fine on Sunday, any idea ?

Pplgingras88 Using toMarkdown on a jpeg in my R2 bucket right now returns AiError: 3043: Inte...

D

david-thyresson•5/29/25, 11:47 AM

Have also seen this since I tried using it yesterday - pdf and csv and xls all converted fine. Just the images error for me. Am using current 4.17.0 of wrangler. Am running local dev.

M

max•5/29/25, 6:50 PM

Hi! Does anyone have any idea why I am getting this error from hitting the Whisper AI endpoint?

{"errors":[{"message":"Error: Network connection lost.","code":6001}],"success":false,"result":{},"messages":[]}

{"errors":[{"message":"Error: Network connection lost.","code":6001}],"success":false,"result":{},"messages":[]}

curl https://api.cloudflare.com/client/v4/accounts/.../ai/run/@cf/openai/whisper  \
  -X POST  \
  -H "Authorization: Bearer ..."  \
  --data-binary "@media.opus"

curl https://api.cloudflare.com/client/v4/accounts/.../ai/run/@cf/openai/whisper  \
  -X POST  \
  -H "Authorization: Bearer ..."  \
  --data-binary "@media.opus"

curl https://api.cloudflare.com/client/v4/accounts/.../ai/run/@cf/openai/whisper  \
  -X POST  \
  -H "Authorization: Bearer ..."  \
  --data-binary "@media.opus"

curl https://api.cloudflare.com/client/v4/accounts/.../ai/run/@cf/openai/whisper  \
  -X POST  \
  -H "Authorization: Bearer ..."  \
  --data-binary "@media.opus"

P

plgingras88•5/29/25, 8:58 PM

Unsure if it's all related but something seems odd with workers AI since yesterday. Nothing seems to have been raised in the status channel

S

SODaLC•5/30/25, 5:10 PM

Anyone know why AI responses keep switching between structed json and broken json strings? I am using @cf/meta/llama-3.2-11b-vision-instruct.

SSODaLC Anyone know why AI responses keep switching between structed json and broken jso...

V

Viktor•5/30/25, 8:38 PM

I noticed a lot of these errors when not using complete inputs; e.g. just sending a system prompt or not having a user prompt or tool response as last input.

VViktor I noticed a lot of these errors when not using complete inputs; e.g. just sendin...

S

SODaLC•5/31/25, 2:05 PM

Thats good to know for the future. I just checked to make sure; i did have a system prompt and user prompt in my input in that order.

S

Shados•6/1/25, 3:51 AM

Out of curiosity, what do folks who use the Cloudflare Worker AI stuff feel about its pricing model? I did some comparisons since we have Azure OpenAI and Cloudflare available at work, and unlike other CF offerings (eg: Cloudflare Workers themselves), it looked surprisingly expensive. The mid range llama models are priced about the same as Azure OpenAI Nano/Mini per million token, give or take (its not an apple to apple comparison), while I expected them to be much cheaper. The 10k neurons a day not withstanding (which, to be fair, does make a decent difference)

Is there something I'm overlooking? I'm just comparing input/output tokens here, so its a pretty naive comparisons, since again its tough to compare "equivalent" models between Llama models and the GPTs.

SShados 👋 Out of curiosity, what do folks who use the Cloudflare Worker AI stuff feel a...

Z

zensin•6/1/25, 7:40 AM

I'm only using them for dev testing because of price and the models being offered are old/outdated. For me to consider using it, I would need up to date models and pricing similar to openrouter.

Z

zensin•6/1/25, 7:48 AM

I expect there to maybe be a slight premium for being close to all the users and not having cold-start issues but the cases where that makes a big difference are few

Z

zensin•6/1/25, 7:51 AM

the AI gateway on the other hand is great, and has a lot more potential to realize.

Y

yinxingmaiming6409•6/1/25, 2:03 PM

Is there a way to obtain the image embedding on CF?

I

implicit-invocation•6/3/25, 3:27 AM

when to expect the new open source models like

gemini-3n

gemini-3n

and

chatterbox-tts

chatterbox-tts

? is there any place to request and vote?

O

octopus8717•6/3/25, 8:20 PM

Hello, I'm using worker with default LLM Chat App Template. Is it possible to connect remote MCP to it?

G

gabrielstuff•6/5/25, 6:09 PM

Hello, is there any roadmap for custom model support ? Like on the fly model download from hugging face ?

G

gabrielstuff•6/5/25, 6:19 PM

The only useful info I’ve come across so far is from here:
https://community.cloudflare.com/t/newer-ai-models-bring-your-own-model/597274
https://github.com/cloudflare/cloudflare-docs/issues/11039
https://developers.cloudflare.com/changelog/

At the moment, “bring your own model” is something very few platforms do well. Among the better ones, I’d say Scaleway Managed Inference and Deepinfra are leading the pack.

Being able to plug in your own model, especially for tasks like completion or classification, is a huge deal. It opens the door to running smaller, highly optimized models, including those trained for other languages or specific domains. And for fine-tuned models, this could really set Cloudflare apart if done right !

GitHub

Ai model deployment, can we deploy our models to cloudflare? · Iss...

Which Cloudflare product(s) does this pertain to? Workers Subject Matter AI workers Content Location https://github.com/cloudflare/cloudflare-docs/blob/production/content/workers-ai/models/embeddin...

Cloudflare Docs

Changelogs

Ggabrielstuff Hello, is there any roadmap for custom model support ? Like on the fly model dow...

I

Isaac McFadyen•6/5/25, 7:55 PM

?workers-ai-models

S

SuperHelpflare•6/5/25, 7:55 PM

Workers AI currently only supports popular open-source models provided by the Cloudflare team, as well as your own LoRAs that can be applied on top of the Cloudflare-provided models. You cannot currently upload your own models or use a model from HuggingFace. See the documentation for the list of Cloudflare-provided models: https://developers.cloudflare.com/workers-ai/models/

S

SuperHelpflare•6/6/25, 8:02 AM

Please do not ping community members for non-moderation reasons. Doing so will not solve your issue faster and will make people less likely to want to help you.

Z

Zig•6/6/25, 6:16 PM

any plans for adding flux kontext?

ZZig any plans for adding flux kontext?

I

Isaac McFadyen•6/6/25, 7:08 PM

At the moment Flux Kontext is not an open-weight model, so I expect they wouldn't add it until if/when it becomes open-weight the same as Flux is.

Z

Zig•6/6/25, 7:09 PM

Thanks sorry I thought it was

ZZig Thanks sorry I thought it was

I

Isaac McFadyen•6/6/25, 7:10 PM

I believe BFL has announced that they plan to make it open-weight (or, well, a lighter version of it the same as they've done with Flux Dev/Schnell vs Pro) but haven't actually done that yet.

IIsaac McFadyen ?workers-ai-models

G

gabrielstuff•6/7/25, 11:14 AM

Yes

A

Advany•6/7/25, 11:31 AM

For agents sdk, using the starter kit, when doing npm update. It started to fail. I had to add

import { defineWorkersConfig } from "@cloudflare/vitest-pool-workers/config";

export default defineWorkersConfig({
environments: {
ssr: {
keepProcessEnv: true,
},
},
test: {
poolOptions: {
workers: {
wrangler: { configPath: "./wrangler.jsonc" },
},
},
},
resolve: {
alias: {
ajv: 'ajv/dist/ajv.min.js',
},
},
optimizeDeps: {
include: ['ajv'],
},
});

To vitest to make it work again!

AAdvany For agents sdk, using the starter kit, when doing npm update. It started to fail...

A

Advany•6/7/25, 11:32 AM

so the way to replicate it is create agents sdk using the starter, then npm update. It will show something like

 FAIL  tests/index.test.ts [ tests/index.test.ts ]
SyntaxError: Unexpected token ':'
 ❯ Users/advany/Documents/GitHub/generator-agent/node_modules/ajv/lib/definition_schema.js?mf_vitest_no_cjs_esm_shim:3:18
 ❯ Users/advany/Documents/GitHub/generator-agent/node_modules/ajv/lib/keyword.js?mf_vitest_no_cjs_esm_shim:5:24
 ❯ Users/advany/Documents/GitHub/generator-agent/node_modules/ajv/lib/ajv.js?mf_vitest_no_cjs_esm_shim:29:21

 FAIL  tests/index.test.ts [ tests/index.test.ts ]
SyntaxError: Unexpected token ':'
 ❯ Users/advany/Documents/GitHub/generator-agent/node_modules/ajv/lib/definition_schema.js?mf_vitest_no_cjs_esm_shim:3:18
 ❯ Users/advany/Documents/GitHub/generator-agent/node_modules/ajv/lib/keyword.js?mf_vitest_no_cjs_esm_shim:5:24
 ❯ Users/advany/Documents/GitHub/generator-agent/node_modules/ajv/lib/ajv.js?mf_vitest_no_cjs_esm_shim:29:21

 FAIL  tests/index.test.ts [ tests/index.test.ts ]
SyntaxError: Unexpected token ':'
 ❯ Users/advany/Documents/GitHub/generator-agent/node_modules/ajv/lib/definition_schema.js?mf_vitest_no_cjs_esm_shim:3:18
 ❯ Users/advany/Documents/GitHub/generator-agent/node_modules/ajv/lib/keyword.js?mf_vitest_no_cjs_esm_shim:5:24
 ❯ Users/advany/Documents/GitHub/generator-agent/node_modules/ajv/lib/ajv.js?mf_vitest_no_cjs_esm_shim:29:21

 FAIL  tests/index.test.ts [ tests/index.test.ts ]
SyntaxError: Unexpected token ':'
 ❯ Users/advany/Documents/GitHub/generator-agent/node_modules/ajv/lib/definition_schema.js?mf_vitest_no_cjs_esm_shim:3:18
 ❯ Users/advany/Documents/GitHub/generator-agent/node_modules/ajv/lib/keyword.js?mf_vitest_no_cjs_esm_shim:5:24
 ❯ Users/advany/Documents/GitHub/generator-agent/node_modules/ajv/lib/ajv.js?mf_vitest_no_cjs_esm_shim:29:21

I fixed it but adding

 resolve: {
    alias: {
      ajv: 'ajv/dist/ajv.min.js',
    },
  },
  optimizeDeps: {
    include: ['ajv'],
  },

 resolve: {
    alias: {
      ajv: 'ajv/dist/ajv.min.js',
    },
  },
  optimizeDeps: {
    include: ['ajv'],
  },

 resolve: {
    alias: {
      ajv: 'ajv/dist/ajv.min.js',
    },
  },
  optimizeDeps: {
    include: ['ajv'],
  },

 resolve: {
    alias: {
      ajv: 'ajv/dist/ajv.min.js',
    },
  },
  optimizeDeps: {
    include: ['ajv'],
  },

LLiam HUGE loss of about 99% of AI requests failing currently...[Last 3 hours]

G

gabrielstuff•6/7/25, 1:58 PM

I can’t manage to run ai workers properly on my side

Hey, has there been any considerations for having the Workers option be limited to storage in the EU

Similar Threads