so if I upgrade to the $5 a month plan I get infinite ai requests? - Cloudflare Developers

© 2026 Hedgehog Software, LLC

More

Communities Docs About Terms Privacy

prisum 🎄

Pprisum 🎄so if I upgrade to the $5 a month plan I get infinite ai requests?

GaryLi

G

GaryLi•2/8/25, 10:42 AM

go to docs, theres s pricing list for ai

Puliczek

P

Puliczek•2/8/25, 12:36 PM

what type of MCP is used by worker-mcp? command or SSE?

nukely

N

nukely•2/8/25, 5:37 PM

any tutorial on how to use Gemini Multimodal Live API with nextjs and a websocket server

GaryLi

GGaryLi go to docs, theres s pricing list for ai

prisum 🎄

P

prisum 🎄OP•2/8/25, 6:49 PM

Yeah I did but on the direct worker ai page it says 30,000 requests monthly but on the pricing document it says unlimited

prisum 🎄

Pprisum 🎄Yeah I did but on the direct worker ai page it says 30,000 requests monthly but ...

Nutjob 홍

N

Nutjob 홍•2/8/25, 10:18 PM

Which page are you looking at?

https://developers.cloudflare.com/workers-ai/platform/pricing/

10,000 free tokens a day and then pricing based on model size and blended input/output tokens.

Cloudflare Docs

Pricing · Cloudflare Workers AI docs

Workers AI is included in both the Free and Paid Workers plans and is priced based on model task, model size, and units.

element14

Eelement14 I would also like to know if there is any REST API Endpoint (or via wrangler com...

user

U

user•2/9/25, 7:59 AM

Anything on this?

Muhammadreza Haghiri

M

Muhammadreza Haghiri•2/9/25, 3:57 PM

Will FLUX-Dev be added to the models as well?

shoo

S

shoo•2/9/25, 5:09 PM

InferenceUpstreamError: undefined: undefined

anyone who knows workaorund to this?

if I use --remote, it doesn't connect to any other worker in local as workers binding

Bob

B

Bob•2/9/25, 7:23 PM

Hello. I have a question.
bge-large-en-v1.5 <- for this model, how many text items I can send in 1 request? I can't seem to find any info on it.

BumblebeeSquare

BBumblebeeSquare hi guys , anyone know why https://github.com/cloudflare/workers-ai-provider does...

BumblebeeSquare

B

BumblebeeSquare•2/10/25, 9:18 PM

leisure

L

leisure•2/11/25, 6:19 AM

Hi, I have a question. When I use it, I find that Daily Usage Limits will not reset at zero normally. Is this a special problem?

BumblebeeSquare

BBumblebeeSquare Empty message

Raylight

R

Raylight•2/11/25, 11:27 AM

Yes. It's not implemented in the package. I created a quick fix (https://github.com/Raylight-PWL/workers-ai-provider/pull/1) but haven't used/tested the package. In any case, you can look at the diff if you want to patch it yourself.

GaryLi

GGaryLi asking if workers ai can get full-sized deepseek r1 model

GaryLi

G

GaryLi•2/11/25, 3:34 PM

idk why they dont put this on

rob

R

rob•2/11/25, 3:48 PM

i dont think they can handle the size

rob

R

rob•2/11/25, 3:48 PM

yet

Marco Aleixo

M

Marco Aleixo•2/11/25, 7:51 PM

do you plan to add more embedding models?
only having a single not multi lingual model available for embedding is kind of a big blocker to use workers ai

beingmudit [WePlayDOS]

B

beingmudit [WePlayDOS]•2/12/25, 9:08 PM

Hi CF team, had a doubt about function calling and the supported model. I can see that only one model is supported but in the documentation of this llama model - https://developers.cloudflare.com/workers-ai/models/llama-3.2-11b-vision-instruct/

I can see in the input/output params, we can pass tools. Is there a documentation mismatch?

Cloudflare Docs

llama-3.2-11b-vision-instruct · Cloudflare Workers AI docs

The Llama 3.2-Vision instruction-tuned models are optimized for visual recognition, image reasoning, captioning, and answering general questions about an image.

beingmudit [WePlayDOS]

B

beingmudit [WePlayDOS]•2/12/25, 9:48 PM

One more q - I am trying out the hermes model and sending this payload as per this example - https://developers.cloudflare.com/workers-ai/function-calling/traditional/

I am using the gateway to make the call - https://gateway.ai.cloudflare.com/v1/{ACC_ID}/{gateway}/workers-ai/v1/chat/completions

const response = await env.AI.run("@hf/nousresearch/hermes-2-pro-mistral-7b", {
  messages: [
    {
      role: "user",
      content: "what is the weather in london?",
    },
  ],
  tools: [
    {
      name: "getWeather",
      description: "Return the weather for a latitude and longitude",
      parameters: {
        type: "object",
        properties: {
          latitude: {
            type: "string",
            description: "The latitude for the given location",
          },
          longitude: {
            type: "string",
            description: "The longitude for the given location",
          },
        },
        required: ["latitude", "longitude"],
      },
    },
  ],
});

return new Response(JSON.stringify(response.tool_calls));

const response = await env.AI.run("@hf/nousresearch/hermes-2-pro-mistral-7b", {
  messages: [
    {
      role: "user",
      content: "what is the weather in london?",
    },
  ],
  tools: [
    {
      name: "getWeather",
      description: "Return the weather for a latitude and longitude",
      parameters: {
        type: "object",
        properties: {
          latitude: {
            type: "string",
            description: "The latitude for the given location",
          },
          longitude: {
            type: "string",
            description: "The longitude for the given location",
          },
        },
        required: ["latitude", "longitude"],
      },
    },
  ],
});

return new Response(JSON.stringify(response.tool_calls));

I am getting back this

{
  "id": "id-1739396566250",
  "object": "chat.completion",
  "created": 1739396566,
  "model": "@hf/nousresearch/hermes-2-pro-mistral-7b",
  "choices": [
    {
      "index": 0,
      "message": {
        "role": "assistant",
        "content": null
      },
      "logprobs": null,
      "finish_reason": "stop"
    }
  ],
  "usage": {
    "input": 15,
    "output": 0,
    "total": 15
  }
}

{
  "id": "id-1739396566250",
  "object": "chat.completion",
  "created": 1739396566,
  "model": "@hf/nousresearch/hermes-2-pro-mistral-7b",
  "choices": [
    {
      "index": 0,
      "message": {
        "role": "assistant",
        "content": null
      },
      "logprobs": null,
      "finish_reason": "stop"
    }
  ],
  "usage": {
    "input": 15,
    "output": 0,
    "total": 15
  }
}

Seems like function calling is not working. Can anyone help?

Cloudflare Docs

Traditional function calling · Cloudflare Workers AI docs

This page shows how you can do traditional function calling, as defined by industry standards. Workers AI also offers embedded function calling, which is drastically easier than traditional function calling.

Jason Barry

J

Jason Barry•2/12/25, 9:52 PM

yes, my function calling isn't working either, using @cf/meta/llama-3.1-8b-instruct-fast@cf/meta/llama-3.1-8b-instruct-fast. I'm seeing a lot of

Error: oneOf at '.' not met: required properties at '.name' is 'type,description', required properties at '.tools.0.function.parameters' is 'type,properties'

Error: oneOf at '.' not met: required properties at '.name' is 'type,description', required properties at '.tools.0.function.parameters' is 'type,properties'

errors in my AI Gateway logs. I'm comparing to requests that I sent last friday -- the request schema I'm using is the same, but something is causing it to error out

Jason Barry

J

Jason Barry•2/12/25, 9:55 PM

internalCode 5006, fwiw

Jason Barry

J

Jason Barry•2/12/25, 9:57 PM

looking in my logs I see the error starting last night, here's an example payload that used to work that is currently failing

{
  "prompt": "Find the computer specs",
  "temperature": 0,
  "messages": [
    {
      "role": "user",
      "content": "..."
    }
  ],
  "tools": [
    {
      "name": "dataExtractor",
      "description": "Extract data that conforms to the provided schema",
      "parameters": {
        "type": "object",
        "properties": {
          "model": {
            "type": "string"
          },
          "cpu": {
            "type": "string"
          },
          "ram": {
            "type": "string"
          },
          "hard_drive": {
            "type": "string"
          },
          "year": {
            "type": "integer"
          },
          "screen_size": {
            "type": "string"
          },
          "dollars": {
            "type": "integer"
          },
          "location": {
            "type": "string"
          },
          "condition": {
            "type": "string",
            "enum": [
              "new",
              "like new",
              "excellent",
              "good",
              "fair",
              "salvage"
            ]
          }
        },
        "required": [
          "model",
          "cpu",
          "ram",
          "hard_drive",
          "year",
          "screen_size",
          "dollars",
          "location",
          "condition"
        ],
        "additionalProperties": false
      }
    }
  ]
}

{
  "prompt": "Find the computer specs",
  "temperature": 0,
  "messages": [
    {
      "role": "user",
      "content": "..."
    }
  ],
  "tools": [
    {
      "name": "dataExtractor",
      "description": "Extract data that conforms to the provided schema",
      "parameters": {
        "type": "object",
        "properties": {
          "model": {
            "type": "string"
          },
          "cpu": {
            "type": "string"
          },
          "ram": {
            "type": "string"
          },
          "hard_drive": {
            "type": "string"
          },
          "year": {
            "type": "integer"
          },
          "screen_size": {
            "type": "string"
          },
          "dollars": {
            "type": "integer"
          },
          "location": {
            "type": "string"
          },
          "condition": {
            "type": "string",
            "enum": [
              "new",
              "like new",
              "excellent",
              "good",
              "fair",
              "salvage"
            ]
          }
        },
        "required": [
          "model",
          "cpu",
          "ram",
          "hard_drive",
          "year",
          "screen_size",
          "dollars",
          "location",
          "condition"
        ],
        "additionalProperties": false
      }
    }
  ]
}

beingmudit [WePlayDOS]

B

beingmudit [WePlayDOS]•2/13/25, 5:41 AM

CF team, can anyone help with yhe above?

Jason Barry

JJason Barry looking in my logs I see the error starting last night, here's an example payloa...

blindChicken

B

blindChicken•2/13/25, 8:58 PM

I think the error may be caused because you did not provide a description for your properties.
You have:

"properties": {
  "model": {
    "type": "string"
  },
  ...

"properties": {
  "model": {
    "type": "string"
  },
  ...

This should be:

"properties": {
  "model": {
    "type": "string",
    "description": "name of the model to be used" //or whatever the appropriate description is
  },
  ...

"properties": {
  "model": {
    "type": "string",
    "description": "name of the model to be used" //or whatever the appropriate description is
  },
  ...

And this should be repeated for each of your props.

Lila Rest

L

Lila Rest•2/13/25, 9:26 PM

Hey! our AI requests are failing with the following rate limit error, while the volume is relatively low ($20 of consumption). That heavily impacts our services
{ message: 'AiError: AiError: Capacity temporarily exceeded, please try again.', code: 3040 } { message: 'AiError: AiError: Capacity temporarily exceeded, please try again.', code: 3040 }

Lila Rest

LLila Rest Hey! our AI requests are failing with the following rate limit error, while the ...

blindChicken

B

blindChicken•2/13/25, 11:28 PM

I was getting the same error, but according to my dashboard I was no where close to the my limit. I think the error is not specific to any one account but may be that the network is overloaded. (I'm speculating) I waited a few minutes and I was able to continue normally.

Tanis Wolfbane

TTanis Wolfbane Any one manage to get flux to work? When I run the exactly example in the docume...

vehu

V

vehu•2/14/25, 1:57 AM

hey, have you found any solution to the problem? (sorry for the ping)

blindChicken

BblindChicken I think the error may be caused because you did not provide a description for yo...

Jason Barry

J

Jason Barry•2/14/25, 2:53 AM

do you know if this requirement changed recently? it seems that last week, there wasn't enforcement of the

description

description

key

Jason Barry

JJason Barry do you know if this requirement changed recently? it seems that last week, there...

blindChicken

B

blindChicken•2/14/25, 3:29 AM

IDK about enforcement, but it is needed so that the model can assign the proper value to the proper properties. Since all this AI stuff is probabilistic it is possible that it can work without the description, and then just as easily not work.

beingmudit [WePlayDOS]

Bbeingmudit [WePlayDOS]CF team, can anyone help with yhe above?

😈 Donkey 💫

�

😈 Donkey 💫•2/14/25, 5:00 AM

only 1 ancient model on CF support Func Calling, even when your payload works, it would return something poor-quality and irrelevant, that's my experience

Lila Rest

LLila Rest Hey! our AI requests are failing with the following rate limit error, while the ...

😈 Donkey 💫

�

😈 Donkey 💫•2/14/25, 5:00 AM

since CF list their inference on OR, I encounter the same problem

blindChicken

BblindChicken I was getting the same error, but according to my dashboard I was no where close...

Lila Rest

L

Lila Rest•2/14/25, 9:23 AM

Same it finally solved by itself after a few hours. That sucks :/

Lila Rest

LLila Rest Same it finally solved by itself after a few hours. That sucks :/

blindChicken

B

blindChicken•2/14/25, 10:08 PM

I agree it sucks, and it would be nice if someone from Cloudflare could chime in a clarify exactly what the error really is:
{ message: 'AiError: AiError: Capacity temporarily exceeded, please try again.', code: 3040 }{ message: 'AiError: AiError: Capacity temporarily exceeded, please try again.', code: 3040 }

atgctg

A

atgctg•2/17/25, 7:20 AM

Tried image generation today, some feedback:

would need 9:16 aspect ratio, only 1:1 is supported
type issues (@cf/black-forest-labs/flux-1-schnell@cf/black-forest-labs/flux-1-schnell is not available as a BaseAiTextToImageModelsBaseAiTextToImageModels)
for schnellschnell, p90 latency should be ~500 ms, not seconds
bindings based api is nice!

Defy

D

Defy•2/17/25, 2:46 PM

Sry is i missunderstand, but i am RN on the free plan, using my 10.000 AI Neurons a day and ran into a problem

The LLM response seems to be arbitrarily cut off at 500 tokens.
is there such a policy? is there a way to disable this or is it just a code issue on my part?

Liam

LLiam Error processing request: 3040: Capacity temporarily exceeded, please try again....

Defy

D

Defy•2/17/25, 3:39 PM

Been getting similar errors when trying to get over 10 requests / second

Liam

LLiam The error is an issue CF end tho not the Rate Limit so its a bit scuffed really....

Defy

D

Defy•2/17/25, 3:40 PM

ah.
i can't help you then.

btw,
any clue how to get more than 500 tokens out of the free tier llm?

blindChicken

B

blindChicken•2/17/25, 9:48 PM

Has anyone tried tool calling with Deepseek-R1Deepseek-R1? When I tried it,the model simply returns a normal response as if tools where not specified. I used the schema that works HermesHermes and LLamaLLama, and I have also tried the schema shown here: https://api-docs.deepseek.com/guides/function_calling. But neither work.

ʙʏᴋᴀɢᴀɴ

ʙ

ʙʏᴋᴀɢᴀɴ•2/18/25, 2:33 PM

help emergency pls (cloud flare)

ʙʏᴋᴀɢᴀɴ

ʙʙʏᴋᴀɢᴀɴ help emergency pls (cloud flare)

MattIPv4

M

MattIPv4•2/18/25, 2:58 PM

You're gonna want to give a bunch more context if you're expecting folks to help

ʙʏᴋᴀɢᴀɴ

ʙʙʏᴋᴀɢᴀɴ help emergency pls (cloud flare)

Wraith

W

Wraith•2/18/25, 3:20 PM

call 911 now bass drop

const response = await env.AI.run("@hf/nousresearch/hermes-2-pro-mistral-7b", {
  messages: [
    {
      role: "user",
      content: "what is the weather in london?",
    },
  ],
  tools: [
    {
      name: "getWeather",
      description: "Return the weather for a latitude and longitude",
      parameters: {
        type: "object",
        properties: {
          latitude: {
            type: "string",
            description: "The latitude for the given location",
          },
          longitude: {
            type: "string",
            description: "The longitude for the given location",
          },
        },
        required: ["latitude", "longitude"],
      },
    },
  ],
});

return new Response(JSON.stringify(response.tool_calls));

const response = await env.AI.run("@hf/nousresearch/hermes-2-pro-mistral-7b", {
  messages: [
    {
      role: "user",
      content: "what is the weather in london?",
    },
  ],
  tools: [
    {
      name: "getWeather",
      description: "Return the weather for a latitude and longitude",
      parameters: {
        type: "object",
        properties: {
          latitude: {
            type: "string",
            description: "The latitude for the given location",
          },
          longitude: {
            type: "string",
            description: "The longitude for the given location",
          },
        },
        required: ["latitude", "longitude"],
      },
    },
  ],
});

return new Response(JSON.stringify(response.tool_calls));

{
  "id": "id-1739396566250",
  "object": "chat.completion",
  "created": 1739396566,
  "model": "@hf/nousresearch/hermes-2-pro-mistral-7b",
  "choices": [
    {
      "index": 0,
      "message": {
        "role": "assistant",
        "content": null
      },
      "logprobs": null,
      "finish_reason": "stop"
    }
  ],
  "usage": {
    "input": 15,
    "output": 0,
    "total": 15
  }
}

{
  "id": "id-1739396566250",
  "object": "chat.completion",
  "created": 1739396566,
  "model": "@hf/nousresearch/hermes-2-pro-mistral-7b",
  "choices": [
    {
      "index": 0,
      "message": {
        "role": "assistant",
        "content": null
      },
      "logprobs": null,
      "finish_reason": "stop"
    }
  ],
  "usage": {
    "input": 15,
    "output": 0,
    "total": 15
  }
}

{
  "prompt": "Find the computer specs",
  "temperature": 0,
  "messages": [
    {
      "role": "user",
      "content": "..."
    }
  ],
  "tools": [
    {
      "name": "dataExtractor",
      "description": "Extract data that conforms to the provided schema",
      "parameters": {
        "type": "object",
        "properties": {
          "model": {
            "type": "string"
          },
          "cpu": {
            "type": "string"
          },
          "ram": {
            "type": "string"
          },
          "hard_drive": {
            "type": "string"
          },
          "year": {
            "type": "integer"
          },
          "screen_size": {
            "type": "string"
          },
          "dollars": {
            "type": "integer"
          },
          "location": {
            "type": "string"
          },
          "condition": {
            "type": "string",
            "enum": [
              "new",
              "like new",
              "excellent",
              "good",
              "fair",
              "salvage"
            ]
          }
        },
        "required": [
          "model",
          "cpu",
          "ram",
          "hard_drive",
          "year",
          "screen_size",
          "dollars",
          "location",
          "condition"
        ],
        "additionalProperties": false
      }
    }
  ]
}

{
  "prompt": "Find the computer specs",
  "temperature": 0,
  "messages": [
    {
      "role": "user",
      "content": "..."
    }
  ],
  "tools": [
    {
      "name": "dataExtractor",
      "description": "Extract data that conforms to the provided schema",
      "parameters": {
        "type": "object",
        "properties": {
          "model": {
            "type": "string"
          },
          "cpu": {
            "type": "string"
          },
          "ram": {
            "type": "string"
          },
          "hard_drive": {
            "type": "string"
          },
          "year": {
            "type": "integer"
          },
          "screen_size": {
            "type": "string"
          },
          "dollars": {
            "type": "integer"
          },
          "location": {
            "type": "string"
          },
          "condition": {
            "type": "string",
            "enum": [
              "new",
              "like new",
              "excellent",
              "good",
              "fair",
              "salvage"
            ]
          }
        },
        "required": [
          "model",
          "cpu",
          "ram",
          "hard_drive",
          "year",
          "screen_size",
          "dollars",
          "location",
          "condition"
        ],
        "additionalProperties": false
      }
    }
  ]
}