opened an isue : https://community.cloudflare.com/t/gemma-aierror-3040-capacity-temporarily-exceeded

J

John Guthrie•5/12/25, 3:31 PM

Hi Cloudflare community,

I'm running into an issue while trying to create a new AutoRAG pipeline through the Cloudflare dashboard. I've successfully gone through the steps:

Connect your data source
Generate indexes
Configure retrieval and generation
However, when I reach the final step (4. Finalize), provide a name for the RAG, and choose "Create one for me" for the Service API Token (it generated AutoRAG Token - 2025-05-06), and then click the "Create" button, I immediately get the following error message:

D1 TYPE ERROR: Type 'object' not supported for value '[object Object]'

It seems like something during the finalization process is trying to pass a JavaScript object [object Object] directly into a D1 database operation where it's not supported.

Has anyone else encountered this specific D1 type error when setting up AutoRAG? Any ideas what configuration step or data aspect might be causing this, or how I can further debug it?

Thanks for any help or pointers!

B

blindChicken•5/12/25, 4:49 PM

I just read this post on CF-Blog about prefix caching: https://blog.cloudflare.com/workers-ai-improvements/#what-is-prefix-caching

The Cloudflare Blog

Workers AI gets a speed boost, batch workload support, more LoRAs, ...

We just made Workers AI inference faster with speculative decoding & prefix caching. Use our new batch inference for handling large request volumes seamlessly. Build tailored AI apps with more LoRA options. Lastly, new models and a refreshed dashboard round out this Developer Week update for Workers AI.

B

blindChicken•5/12/25, 4:50 PM

Is there any detailed info on how to implement / manage this?

A

ajgeiss0702•5/12/25, 8:44 PM

is it not possible to reliably use tools with streaming?

I've been messing with it, and it seems incosistant.

When no tools are specified and streaming is enabled, each chunk includes a

"tool_calls":[]

"tool_calls":[]

"tool_calls":[]

"tool_calls":[] object.

When I keep streaming enabled and add a tool to the request, the

"tool_calls":[]

"tool_calls":[]

"tool_calls":[]

"tool_calls":[] goes away and instead some json is output is streamed in the

response

response

response

response string.
And that json isnt consistant either. Sometimes it includes

"type": "function"

"type": "function"

"type": "function"

"type": "function" and sometimes not.

A

acusti•5/13/25, 3:58 PM

update: this was not actually an error from cloudflare. my assessment of the issue was incorrect, so the following is not accurate.

i’ve been using

@cf/black-forest-labs/flux-1-schnell

@cf/black-forest-labs/flux-1-schnell

@cf/black-forest-labs/flux-1-schnell

@cf/black-forest-labs/flux-1-schnell via the workers AI binding for text-to-image, which recently stopped working for me, giving me this response:

Monthly usage limit for image reached for your plan. Please upgrade.

Monthly usage limit for image reached for your plan. Please upgrade.

Monthly usage limit for image reached for your plan. Please upgrade.

Monthly usage limit for image reached for your plan. Please upgrade.

i couldn’t find any mention of monthly limits in the Limits doc or the Pricing doc. what’s the best way to increase my monthly usage limit for flux schnell?

note: i’m currently on the Workers Paid plan

J

joesepi•5/13/25, 4:38 PM

How does Cloudflare choose the models it makes available on the Cloudflare Workers AI platform? I'd like to try using the open source IBM Granite models but they are not listed. (Disclosure: I work at IBM) Thanks!!!

B

blindChicken•5/13/25, 7:02 PM

I've been getting some strange responses intermittently. The responses have a bunch spaces and line feed characters after an otherwise fine response. I get this a few times in a row and then it stops for while. I'm using Qwen

@cf/qwen/qwen2.5-coder-32b-instruct

@cf/qwen/qwen2.5-coder-32b-instruct

@cf/qwen/qwen2.5-coder-32b-instruct

@cf/qwen/qwen2.5-coder-32b-instruct. This really sucks when your paying for tokens, a couple of hundred token for nothing per request can start to add up.

{{{{ ...the expected response... } } ] } } } \n' +
    '\n' +
    '   \n' +
    '  \n' +
    '  \n' +
    '  \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    ' ',

{{{{ ...the expected response... } } ] } } } \n' +
    '\n' +
    '   \n' +
    '  \n' +
    '  \n' +
    '  \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    ' ',

{{{{ ...the expected response... } } ] } } } \n' +
    '\n' +
    '   \n' +
    '  \n' +
    '  \n' +
    '  \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    ' ',

{{{{ ...the expected response... } } ] } } } \n' +
    '\n' +
    '   \n' +
    '  \n' +
    '  \n' +
    '  \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    '    \n' +
    '  \n' +
    ' ',

I

Ian•5/14/25, 12:17 AM

does cloudflare still support onnx custom models ?

I

Isaac McFadyen•5/14/25, 12:43 AM

?workers-ai-models TLDR: No

S

SuperHelpflare•5/14/25, 12:43 AM

Workers AI currently only supports popular open-source models provided by the Cloudflare team, as well as your own LoRAs that can be applied on top of the Cloudflare-provided models. You cannot currently upload your own models or use a model from HuggingFace. See the documentation for the list of Cloudflare-provided models: https://developers.cloudflare.com/workers-ai/models/

Ggabrielstuff Hello! I hope you’re doing well. I’m experimenting with the Cloudflare AI-Worker...

G

gabrielstuffOP•5/15/25, 9:19 AM

Hello, any news on this topic ?

G

gabrielstuffOP•5/15/25, 9:20 AM

I'm a paying customer and having no response from either the support or someone here, is a bit worrying.

Ggabrielstuff Hello! I hope you’re doing well. I’m experimenting with the Cloudflare AI-Worker...

A

ajgeiss0702•5/15/25, 6:42 PM

yeah, that happens sometimes. just re-try.
if its something not time critical, you can use the batch api to avoid exceeding cf's capacity

Cloudflare Docs

Asynchronous Batch API

Asynchronous batch processing lets you send a collection (batch) of inference requests in a single call. Instead of expecting immediate responses for every request, the system queues them for processing and returns the results later.

Aajgeiss0702 yeah, that happens sometimes. just re-try. if its something not time critical, y...

G

gabrielstuffOP•5/15/25, 7:12 PM

Ok lets retry but I don’t get how’s that supposed to scale with with millions of users …

F

felix_m•5/15/25, 9:00 PM

Hi! Any plans to have an image embedding model available?
I'd love to move my CLIP inferences to CF. That model has 31M downloads last month - it's pretty popular.
https://huggingface.co/openai/clip-vit-large-patch14

openai/clip-vit-large-patch14 · Hugging Face

Ggabrielstuff Ok lets retry but I don’t get how’s that supposed to scale with with millions of...

A

ajgeiss0702•5/15/25, 11:18 PM

in my experience, more than 1 retry a second later has never been needed, but I don't have millions of users

✎

✎ℳ㎕Joy485@新歲錦時•5/16/25, 2:18 PM

I made an chat AI worker project
Recommended: https://github.com/qyjoy/Gemini-CFworker

GitHub

GitHub - qyjoy/Gemini-CFworker: 🌐 A simple Cloudflare Worker - S...

A simple Cloudflare Worker - Serverless &amp; Cost-Effective: No need to rent or manage your own server. Cloudflare Workers operate on a serverless model, and the free tier is often sufficien...

J

JZ•5/17/25, 7:35 AM

Anyone successfully run the example of MCP with auth in this doc?
https://developers.cloudflare.com/agents/guides/remote-mcp-server/

I keep getting error below:

⎔ Starting local server...
[wrangler:inf] Ready on http://localhost:8788
✘ [ERROR] OAuth error response: 401 invalid_token - Missing or invalid access token


[wrangler:inf] POST /sse 401 Unauthorized (6ms)
[wrangler:inf] GET /.well-known/oauth-authorization-server 200 OK (1ms)
[wrangler:inf] GET /authorize 302 Found (68ms)
[wrangler:inf] GET /callback 302 Found (871ms)
[wrangler:inf] GET /.well-known/oauth-authorization-server 200 OK (2ms)
✘ [ERROR] OAuth error response: 401 invalid_client - Client not found


[wrangler:inf] POST /token 401 Unauthorized (3ms)

⎔ Starting local server...
[wrangler:inf] Ready on http://localhost:8788
✘ [ERROR] OAuth error response: 401 invalid_token - Missing or invalid access token


[wrangler:inf] POST /sse 401 Unauthorized (6ms)
[wrangler:inf] GET /.well-known/oauth-authorization-server 200 OK (1ms)
[wrangler:inf] GET /authorize 302 Found (68ms)
[wrangler:inf] GET /callback 302 Found (871ms)
[wrangler:inf] GET /.well-known/oauth-authorization-server 200 OK (2ms)
✘ [ERROR] OAuth error response: 401 invalid_client - Client not found


[wrangler:inf] POST /token 401 Unauthorized (3ms)

⎔ Starting local server...
[wrangler:inf] Ready on http://localhost:8788
✘ [ERROR] OAuth error response: 401 invalid_token - Missing or invalid access token


[wrangler:inf] POST /sse 401 Unauthorized (6ms)
[wrangler:inf] GET /.well-known/oauth-authorization-server 200 OK (1ms)
[wrangler:inf] GET /authorize 302 Found (68ms)
[wrangler:inf] GET /callback 302 Found (871ms)
[wrangler:inf] GET /.well-known/oauth-authorization-server 200 OK (2ms)
✘ [ERROR] OAuth error response: 401 invalid_client - Client not found


[wrangler:inf] POST /token 401 Unauthorized (3ms)

⎔ Starting local server...
[wrangler:inf] Ready on http://localhost:8788
✘ [ERROR] OAuth error response: 401 invalid_token - Missing or invalid access token


[wrangler:inf] POST /sse 401 Unauthorized (6ms)
[wrangler:inf] GET /.well-known/oauth-authorization-server 200 OK (1ms)
[wrangler:inf] GET /authorize 302 Found (68ms)
[wrangler:inf] GET /callback 302 Found (871ms)
[wrangler:inf] GET /.well-known/oauth-authorization-server 200 OK (2ms)
✘ [ERROR] OAuth error response: 401 invalid_client - Client not found


[wrangler:inf] POST /token 401 Unauthorized (3ms)

Cloudflare Docs

Build a Remote MCP server

This guide will show you how to deploy your own remote MCP server on Cloudflare, with two options:

JJZ Anyone successfully run the example of MCP with auth in this doc? https://devel...

I

Isaac McFadyen•5/17/25, 12:52 PM

?crossposting

S

SuperHelpflare•5/17/25, 12:52 PM

Please do not post your question in multiple channels/post it multiple times per the rules at #

welcome-and-rules. It creates confusion for people trying to help you and doesn't get your issue or question solved any faster.

✎

✎ℳ㎕Joy485@新歲錦時•5/17/25, 4:06 PM

https://github.com/qyjoy/Gemini-CFworker/releases/tag/4.0
4.0!

✎✎ℳ㎕Joy485@新歲錦時 https://github.com/qyjoy/Gemini-CFworker/releases/tag/4.0 4.0!

I

Isaac McFadyen•5/17/25, 4:12 PM

Is this related to Cloudflare/Workers AI at all? A quick look makes it seems like it's using Gemini?

IIsaac McFadyen Is this related to Cloudflare/Workers AI at all? A quick look makes it seems lik...

✎

✎ℳ㎕Joy485@新歲錦時•5/17/25, 4:14 PM

check readme

✎✎ℳ㎕Joy485@新歲錦時 check readme

I

Isaac McFadyen•5/17/25, 4:14 PM

Yes but this is the Workers AI channel, not for general Workers apps.

✎

✎ℳ㎕Joy485@新歲錦時•5/17/25, 4:16 PM

why tf would we be the traditional way

✎

✎ℳ㎕Joy485@新歲錦時•5/17/25, 4:18 PM

with Poor adaptability and a deployment cycle as slow as a turtle

I

Isaac McFadyen•5/17/25, 4:19 PM

I'm not sure what you mean but what I was trying to say is that you posted an app unrelated to Cloudflare Workers AI in a channel meant for only Cloudflare Workers AI questions. Please avoid doing that in the future.

Y

yinxingmaiming6409•5/20/25, 3:29 AM

Why does AI have neuron prices and token prices? What price should I consider for my worker paid? Or should we charge double the price?

Y

yinxingmaiming6409•5/20/25, 3:32 AM

@How to use Woekr AI to extract the vector of r2 image from CF/Microsoft/Resnet-50 and save it to vectordb? Do you have any examples?

Y

yinxingmaiming6409•5/20/25, 3:39 AM

Yyinxingmaiming6409 Why does AI have neuron prices and token prices? What price should I consider fo...

V

Viktor•5/20/25, 12:38 PM

They are the same. Different models use a different amount of neurons per token, so it tells you both prices - the neuron price (which is the same for all models) and the price per token per model (which differs, as models have different neurons/tokens). Cloudflare used to bill only per neuron, but as every ai provider has price per token, they added that, too

VViktor They are the same. Different models use a different amount of neurons per token,...

Y

yinxingmaiming6409•5/20/25, 3:02 PM

Resnet50 can extract embeddings, can't you?

Yyinxingmaiming6409 Resnet50 can extract embeddings, can't you?

V

Viktor•5/20/25, 3:09 PM

It doesn't look like that. I'd say it does return a list of things it recognised, and not an embedding

M

MSL•5/20/25, 3:36 PM

Hey, has there been any considerations for having the Workers option be limited to storage in the EU to abide by GDPR-Compliance? Something like the " Cloudflare Data Localization Suite" but without having to be inside an Enterprise suite

MMSL Hey, has there been any considerations for having the Workers option be limited ...

V

Viktor•5/21/25, 9:08 AM

Cloudflare is certified by eu us data privacy framework, it is GDPR compliant. But for some storage options (like R2, D1) you can already set a region. You posted this question in workers-ai and asked about storage - do you mean specifically vectorize?

VViktor Cloudflare is certified by eu us data privacy framework, it is GDPR compliant. B...

M

MSL•5/21/25, 9:36 AM

No, I am specifically talking about Workers, since they run on all network locations that can potentially be a GDPR issue for data handling,
It’s not as easy as them being certified, if a worker parses sensitive data but is hosted outside of the EU that can be an issue even with the Cloudflare DPA should cover it, it depends on the data you’re handling

M

MSL•5/21/25, 9:43 AM

Searching for it also shows people arguing and general confusion regarding the DPA with no official reply from Cloudflare except “You can sign a DPA with us” but Pages and Workers are specifically written to not be an option to have Data Localization only in the EU. Which is where I doubt the management of GDPR is sufficient, as the processor I would still be the one with fines if some data is processed outside of the EU

M

Mochni•5/21/25, 11:54 PM

Hi

M

Mochni•5/21/25, 11:55 PM

It says I used 691.2/10k neurons, but the chart says I used 16.93k neurons

M

Mochni•5/21/25, 11:55 PM

What am I missing here?

O

Object•5/23/25, 9:24 PM

Hello, reporting an issue with Gemma 3 in Workers AI, or maybe just the documentation about it.

The Gemma 3 model is not behaving as documented. Two issues so far:
1. (minor but a bit annoying) "@cf/google/gemma-3-12b-it" is not included in

wrangler types

wrangler types

wrangler types

wrangler types
2. the following code chokes, even though correct per the official doc page (https://developers.cloudflare.com/workers-ai/models/gemma-3-12b-it/) . The part it dislikes is

messages[1].content

messages[1].content

messages[1].content

messages[1].content being an object instead of string. The string format only works for text, however, not image, i.e.

{role: 'user', content: dataUri}

{role: 'user', content: dataUri}

{role: 'user', content: dataUri}

{role: 'user', content: dataUri} will not choke but Gemma will completely hallucinate the actual content of the image, while recognizing the same image just fine if uploaded in aistudio.google.com.

const res = await fetch(

https://cataas.com/cat

https://cataas.com/cat

https://cataas.com/cat

https://cataas.com/cat);
const blob = await res.arrayBuffer();
const imageData = [...new Uint8Array(blob)];

const base64 = btoa(String.fromCharCode(...imageData));
const dataUri =

data:image/jpeg;base64,${base64}

data:image/jpeg;base64,${base64}

data:image/jpeg;base64,${base64}

data:image/jpeg;base64,${base64};

const response = await env.AI.run(
"@cf/google/gemma-3-12b-it",
{
messages: [
{role: 'system', content: 'describe uploaded images'},
{role: 'user',
content: {
type: 'image', // tried with and without this line
image_url: {url: dataUri}
}
}
]
}).catch(e => {
console.error(

AI.run error

AI.run error

AI.run error

AI.run error, e);
throw e;
});

return new Response(JSON.stringify(response), {
headers: [['content-type', 'application/json']]
});

O

Object•5/23/25, 9:28 PM

Here is the error the run API returns:
✘ [ERROR] AI error InferenceUpstreamError [AiError]: 3030: 3 validation errors for ValidatorIterator

0.typed-dict
Input should be a valid dictionary [type=dict_type, input_value='image_url', input_type=str]
For further information visit https://errors.pydantic.dev/2.10/v/dict_type
0.typed-dict
Input should be a valid dictionary [type=dict_type, input_value='image_url', input_type=str]
For further information visit https://errors.pydantic.dev/2.10/v/dict_type
0.typed-dict
Input should be a valid dictionary [type=dict_type, input_value='image_url', input_type=str]
For further information visit https://errors.pydantic.dev/2.10/v/dict_type
at Ai._parseError (cloudflare-internal:ai-api:102:24)
at async Ai.run (cloudflare-internal:ai-api:82:19)
at response (file:///<...>/classify.ts:58:20)
at async Object.fetch
(file:///<...>node_modules/src/src/Router.ts:58:20)
at async jsonError
(file:///<...>/node_modules/wrangler/templates/middleware/middleware-miniflare3-json-error.ts:22:10)
at async drainBody
(file:///<...>node_modules/wrangler/templates/middleware/middleware-ensure-req-body-drained.ts:5:10)

S

SODaLC•5/25/25, 2:59 PM

Im current running into an error about "JSON Model couldn't be met" . Is there a way to tell why this is happening or what it is having trouble with with some sort of verbose mode? At the moment, it very inconsistent.

Z

zensin•5/27/25, 4:07 AM

Please add Devstral-Small-2505 if possible
https://huggingface.co/mistralai/Devstral-Small-2505
https://huggingface.co/unsloth/Devstral-Small-2505

D

Dev•5/27/25, 5:02 AM

Hi, why can't we use BGE-M3 embedding model (@cf/baai/bge-m3) to create vector index?

Only these model are available to choose from: [ "@cf/baai/bge-small-en-v1.5", "@cf/baai/bge-base-en-v1.5", "@cf/baai/bge-large-en-v1.5", "openai/text-embedding-ada-002", "cohere/embed-multilingual-v2.0" ]

E

eli-front•5/27/25, 11:16 PM

Has anyone successfully setup tool call streaming with any of the function calling models? I can get tool calling to work when it's not streaming.

DDev Hi, why can't we use BGE-M3 embedding model (@cf/baai/bge-m3) to create vector i...

V

Viktor•5/28/25, 10:46 AM

I have no idea what you mean, but you can create a vector index with length = 1024 via wrangler, and store vectors created via bge-m3 in it

Eeli-front Has anyone successfully setup tool call streaming with any of the function calli...

V

Viktor•5/28/25, 10:49 AM

I buffered the first bytes and checked if they contain json or xml (depending on the model). If it does not start with

{"

{"

{"

{" or

<function

<function

<function

<function (it was I think) it's not a function call, else it is one. In theory @cloudflare/ai-utils can do that, but it calls the model twice (once without streaming and in case it does not call a tool - again with streaming), so I didn't want to use it

GitHub

GitHub - cloudflare/ai-utils: Developer toolkit that makes it simpl...

Developer toolkit that makes it simple to build with the Workers AI platform. - cloudflare/ai-utils

opened an isue : https://community.cloudflare.com/t/gemma-aierror-3040-capacity-temporarily-exceeded

Similar Threads

Similar Threads

Similar Threads