is the api docs for the traditional tool calling out of date? - Cloudflare Developers

© 2026 Hedgehog Software, LLC

More

Communities Docs About Terms Privacy

J

jd•9/4/25, 5:54 AM

im super excited about workers ai https://blog.cloudflare.com/workers-ai/

and curious what's the latest status on it? im primarily looking into deploying my custom python script + model with compilation graph cache and see if cloudflare is able to run it at global scale serverless. with great cold start time.

The Cloudflare Blog

Workers AI: serverless GPU-powered inference on Cloudflare’s glob...

We are excited to launch Workers AI - an AI inference as a service platform, empowering developers to run AI models with just a few lines of code, all powered by our global network of GPUs

Workers AI: serverless GPU-powered inference on Cloudflare’s glob...

J

jd•9/4/25, 5:55 AM

for models im mean tasks like

1) upscaling
2) voice gen
3) ad-hoc AI processing
4) or even large diffusion transformer models that could take minimum of H100 to run if that's on the roadmap

zsueo

Zzsueo is the api docs for the traditional tool calling out of date?

zsueo

Z

zsueoOP•9/4/25, 10:04 AM

actually is there documentation on how the ai is supposed to return tool calls?

yureckey

Y

yureckey•9/4/25, 10:12 AM

I'm testing aura-1 text2speech. There is no mentioning of Text input limit, but it seems to have 2k symbols limit (as I understand Deepgram have this limit). When the text is bigger - there is no proper error message, please fix (and add to doc)

zsueo

Zzsueo is the api docs for the traditional tool calling out of date?

Ana

A

Ana•9/4/25, 11:56 AM

Probably, though it works for the hermes model. https://developers.cloudflare.com/workers-ai/features/function-calling/

Ana

AAna Probably, though it works for the hermes model. https://developers.cloudflare.co...

zsueo

Z

zsueoOP•9/4/25, 12:03 PM

thanks! though i think the problem im facing is that A) my code was buggy and B) the input schema changed

zsueo

Z

zsueoOP•9/4/25, 12:03 PM

took me a while to figure that out tho

Sunil Pai

SSunil Pai folks, we just published v2.0.0 of workers-ai-provider, the main feature of whic...

Proman4713 🇵🇸

P

Proman4713 🇵🇸•9/4/25, 5:34 PM

does this fix the issue we were talking about?

Sunil Pai

SSunil Pai sorry, not sure what issue you're referring to

Proman4713 🇵🇸

P

Proman4713 🇵🇸•9/4/25, 5:34 PM

AiError: Invalid Input 8081 when trying to use traditional function calling

Proman4713 🇵🇸

P

Proman4713 🇵🇸•9/4/25, 5:35 PM

the response from the AI request (decoded from base64 after setting log-level to debug and turning off sanitisation):

{"httpCode":400,"internalCode":8001,"message":"AiError: AiError: Invalid input (95e650b5-30fd-461e-a800-95d18c5295ef)","name":"AiError","skipSentry":true,"description":"Invalid input"}

{"httpCode":400,"internalCode":8001,"message":"AiError: AiError: Invalid input (95e650b5-30fd-461e-a800-95d18c5295ef)","name":"AiError","skipSentry":true,"description":"Invalid input"}

Sunil Pai

SSunil Pai just saw it. this wasn't related to that, this is the library on top of workers-...

Proman4713 🇵🇸

P

Proman4713 🇵🇸•9/4/25, 5:36 PM

oh okay, but still this issue works whenever i add toolstools to my AI.run function

Proman4713 🇵🇸

P

Proman4713 🇵🇸•9/4/25, 5:37 PM

i was in the wrong channel, but these are the details: coding-help

Sunil Pai

SSunil Pai just saw it. this wasn't related to that, this is the library on top of workers-...

Proman4713 🇵🇸

P

Proman4713 🇵🇸•9/4/25, 6:32 PM

uhhh sorry i meant "this issue happens" not works

Proman4713 🇵🇸

P

Proman4713 🇵🇸•9/4/25, 6:32 PM

it doesnt work

Proman4713 🇵🇸

P

Proman4713 🇵🇸•9/4/25, 6:32 PM

it shows this error whenever i try to use traditional function calling

starcarlos.

S

starcarlos.•9/5/25, 3:00 AM

When I use worker ai, I get an error.
429 , reason: Too Many Requests,text:{"errors":[{"message":"AiError: AiError: Capacity temporarily exceeded, please try again.

maj

M

maj•9/5/25, 5:52 AM

I'm trying to use AutoRAG to spell check names. I have a list of names in a R2 bucket (split in ~3MB chunks). AutoRAG claims it finished processing them. I then use c.env.AI.autorag('my-rag-name').aiSearch()c.env.AI.autorag('my-rag-name').aiSearch() to ask it basically "give me the correct version of the given name". Hoping it would fix the spelling of "Suma Covjek" to "Šuma Čovjek", as listed in one of the files. But results are underwhelming. When I looked at the AI Gateway and what the aiSearch()aiSearch() used for the default system message, I see "...no relevant documents were retrieved for the user's query...". For each and all of them. If I do a search in the playground it would sometimes return a file, but often not the right or relevant one, even if the exact correct spelling is given. What am I missing? How come aiSearch()aiSearch() would not find my content?

Daniel

D

Daniel•9/5/25, 3:09 PM

are the types for the new deepgram models not up-to-date?

I am getting:

Argument of type '"@cf/deepgram/nova-3"' is not assignable to parameter of type 'keyof AiModels'.ts(2345)

this.env.AI.run(
        "@cf/deepgram/nova-3"

Argument of type '"@cf/deepgram/nova-3"' is not assignable to parameter of type 'keyof AiModels'.ts(2345)

this.env.AI.run(
        "@cf/deepgram/nova-3"

Pingo

P

Pingo•9/8/25, 1:59 PM

Hi friends, has someone been able to add workers-ai to vs code extension cline or similar? I've been trying for months with no success. I tried the openai-compat providor route but kept getting errors. I've already connected in cline groq, mistral, cerebus, openrouter, gemini, and it was quite straight forward. Workers-ai in cline would be awesome. Btw I got curl test to work easily with and without ai gateway.

samjs

Ssamjs Sorry for the delay folks. I'm out of office this week but will look into this n...

Proman4713 🇵🇸

P

Proman4713 🇵🇸•9/8/25, 5:11 PM

any news?

yureckey

Y

yureckey•9/9/25, 5:05 AM

https://developers.cloudflare.com/workers-ai/models/lucid-origin/
there are two identical parameters "steps" and "num_steps" - so, which is correct? or I can use either one?

Cloudflare Docs

Lucid Origin from Leonardo.AI is their most adaptable and prompt-responsive model to date. Whether you're generating images with sharp graphic design, stunning full-HD renders, or highly specific creative direction, it adheres closely to your prompts, renders text with accuracy, and supports a wide array of visual styles and aesthetics – from ...

lucid-origin

yureckey

Yyureckey https://developers.cloudflare.com/workers-ai/models/lucid-origin/ there are two ...

samjs

S

samjs•9/9/25, 3:11 PM

Both are fine!

Himanshu

H

Himanshu•9/9/25, 8:05 PM

Wish there were an easy way to try Cloudflare Workers AI models without any setup? I got you…

Well, I just shipped OpenGPT

Live demo: https://opengpt.weblinq.dev/
GitHub: https://github.com/devhims/opengpt

Built with OpenNext, AI SDK, and Workers AI. You can access 50+ models without signup.

If you find it useful, consider giving the repo a star. Thanks!

Himanshu

H

Himanshu•9/10/25, 7:54 PM

I just tried to use deepgram/nova-3 and it still doesn't seem to work. Has anyone used it successfully so far?

Himanshu

HHimanshu I just tried to use deepgram/nova-3 and it still doesn't seem to work. Has anyon...

Himanshu

H

Himanshu•9/10/25, 8:15 PM

Update: I've been able to get it working with the workers binding api. The requests in Postman are failing with "Error: Network connection lost."

toadilywasted

T

toadilywasted•9/11/25, 1:42 AM

Any chance we'll get a new llamaguard model anytime soon?

Ana

AAna Hello. I’m experimenting with Traditional function calling and it seems to only ...

Ana

A

Ana•9/11/25, 10:14 AM

Hi @samjs any updates on this? Sorry to mention you directly, but saw that you created threads for other questions.

Tim

T

Tim•9/11/25, 10:51 AM

Hi, are websockets available for the new Nova 3 ASR model?

Tim

TTim Hi, are websockets available for the new Nova 3 ASR model?

samjs

S

samjs•9/11/25, 1:59 PM

They should be! I think docs are still WIP so let me try and put together a short example for you

Himanshu

H

Himanshu•9/11/25, 5:37 PM

Hey @samjs , I'd like to report a bug in the documentation of MeloTTS model:
https://developers.cloudflare.com/workers-ai/models/melotts/

As per the docs, we can set the langlang field to

en

en

or frfr. While

en

en

works, we get AiError: AiError: Invalid inputAiError: AiError: Invalid input if we set the lang to frfr.

I checked the GitHub page of MeloTTS, and it seems the correct language codes that it expects are: EN, ES, FR, ZH, JP, KR

Himanshu

HHimanshu Hey @samjs , I'd like to report a bug in the documentation of MeloTTS model: ht...

samjs

S

samjs•9/11/25, 6:32 PM

Hey @Himanshu. Thanks for raising this. You're right it looks like we currently only download the weights for the english model.

samjs

Ssamjs Hey @Himanshu. Thanks for raising this. You're right it looks like we currently ...

Himanshu

H

Himanshu•9/11/25, 6:50 PM

I find the quality of the outputs with MeloTTS really good. Would request support for other languages and speaker accents for English - it allows US, UK, among others.

Tim

T

Tim•9/12/25, 5:21 AM

Is there any intention to support Kokoro TTS?

Proman4713 🇵🇸

P

Proman4713 🇵🇸•9/12/25, 8:10 AM

when i run mistral ai it works fine, but if it asks for tool_calls, and i execute the calls, then give it back the

messages

messages

array with the { role: "tool" }{ role: "tool" } items, it shows me this error:

{"httpCode":500,"internalCode":3043,"message":"AiError: AiError: Internal server error (40099610-8d16-4868-9093-de9bafb5818f)","name":"AiError","skipSentry":true,"description":"Internal server error"}

{"httpCode":500,"internalCode":3043,"message":"AiError: AiError: Internal server error (40099610-8d16-4868-9093-de9bafb5818f)","name":"AiError","skipSentry":true,"description":"Internal server error"}

this is decoded from base64 network response, actual console error is just this:

[wrangler:error] AiError: 3043: Internal server error
    at Ai._parseError (cloudflare-internal:ai-api:212:24)
    at async Ai.run (cloudflare-internal:ai-api:190:19)
    at async runWorker (file:///home/proman4713/JavaScript%20Projects/MawjoodAPI/src/index.js:50:20)
    at async jsonError (file:///home/proman4713/.nvm/versions/node/v22.13.1/lib/node_modules/wrangler/templates/middleware/middleware-miniflare3-json-error.ts:22:10)
    at async drainBody (file:///home/proman4713/.nvm/versions/node/v22.13.1/lib/node_modules/wrangler/templates/middleware/middleware-ensure-req-body-drained.ts:5:10)

[wrangler:error] AiError: 3043: Internal server error
    at Ai._parseError (cloudflare-internal:ai-api:212:24)
    at async Ai.run (cloudflare-internal:ai-api:190:19)
    at async runWorker (file:///home/proman4713/JavaScript%20Projects/MawjoodAPI/src/index.js:50:20)
    at async jsonError (file:///home/proman4713/.nvm/versions/node/v22.13.1/lib/node_modules/wrangler/templates/middleware/middleware-miniflare3-json-error.ts:22:10)
    at async drainBody (file:///home/proman4713/.nvm/versions/node/v22.13.1/lib/node_modules/wrangler/templates/middleware/middleware-ensure-req-body-drained.ts:5:10)

Proman4713 🇵🇸

P

Proman4713 🇵🇸•9/12/25, 8:22 AM

oww man

Proman4713 🇵🇸

P

Proman4713 🇵🇸•9/12/25, 8:23 AM

nah nevermind

Proman4713 🇵🇸

P

Proman4713 🇵🇸•9/12/25, 8:23 AM

still errors

Proman4713 🇵🇸

P

Proman4713 🇵🇸•9/12/25, 8:24 AM

is it because I'm putting

name

name

in the message element?

Proman4713 🇵🇸

P

Proman4713 🇵🇸•9/12/25, 8:25 AM

well then, i think id should replace name

Proman4713 🇵🇸

P

Proman4713 🇵🇸•9/12/25, 8:25 AM

nope

Proman4713 🇵🇸

P

Proman4713 🇵🇸•9/12/25, 8:25 AM

still errors

Proman4713 🇵🇸

P

Proman4713 🇵🇸•9/12/25, 8:26 AM

"pattern": "[a-zA-Z0-9]{9}""pattern": "[a-zA-Z0-9]{9}" makes sense, but it still doesnt work when i put 0s followed by 1

Proman4713 🇵🇸

P

Proman4713 🇵🇸•9/12/25, 8:34 AM

i just wanna know

Proman4713 🇵🇸

P

Proman4713 🇵🇸•9/12/25, 8:34 AM

is workers AI still in beta or something?

Proman4713 🇵🇸

P

Proman4713 🇵🇸•9/12/25, 8:34 AM

why are the errors so ambiguous?

Proman4713 🇵🇸

P

Proman4713 🇵🇸•9/12/25, 8:35 AM

the model does not return a tool ID, yet I'm expected to provide one? and providing one doesnt fix the issue anyway?

samjs

S

samjs•9/12/25, 1:39 PM

Hey @Proman4713

. FIrst of all, apologies for all the issues you're running into. While the Workers AI platform itself is very mature at this point, we have a fairly long tail of model/software specific nuances that can result in these confusing behaviours/errors.

In this case it seems like the underlying mistral_commonmistral_common package is raising an exception: "Unexpected role 'tool' after role 'user'".

We should at the very least be propagating that error back to you, rather than giving you an opaque server error.

With regards to the error itself, have you tried following the Mistral docs? https://docs.mistral.ai/capabilities/function_calling/

samjs

Ssamjs Hey @Proman4713 🇵🇸 . FIrst of all, apologies for all the issues you're running...

Proman4713 🇵🇸

P

Proman4713 🇵🇸•9/12/25, 2:30 PM

Thank you very much for your attention, I appreciate that.

So the issue was in the appearance of role "tool" after role "user", not in the message object itself? Alright, I guess.

I haven't followed the Mistral docs before, I will look into it in a bit and let you know if the issue is resolved.

{"httpCode":500,"internalCode":3043,"message":"AiError: AiError: Internal server error (40099610-8d16-4868-9093-de9bafb5818f)","name":"AiError","skipSentry":true,"description":"Internal server error"}

{"httpCode":500,"internalCode":3043,"message":"AiError: AiError: Internal server error (40099610-8d16-4868-9093-de9bafb5818f)","name":"AiError","skipSentry":true,"description":"Internal server error"}

[wrangler:error] AiError: 3043: Internal server error
    at Ai._parseError (cloudflare-internal:ai-api:212:24)
    at async Ai.run (cloudflare-internal:ai-api:190:19)
    at async runWorker (file:///home/proman4713/JavaScript%20Projects/MawjoodAPI/src/index.js:50:20)
    at async jsonError (file:///home/proman4713/.nvm/versions/node/v22.13.1/lib/node_modules/wrangler/templates/middleware/middleware-miniflare3-json-error.ts:22:10)
    at async drainBody (file:///home/proman4713/.nvm/versions/node/v22.13.1/lib/node_modules/wrangler/templates/middleware/middleware-ensure-req-body-drained.ts:5:10)

[wrangler:error] AiError: 3043: Internal server error
    at Ai._parseError (cloudflare-internal:ai-api:212:24)
    at async Ai.run (cloudflare-internal:ai-api:190:19)
    at async runWorker (file:///home/proman4713/JavaScript%20Projects/MawjoodAPI/src/index.js:50:20)
    at async jsonError (file:///home/proman4713/.nvm/versions/node/v22.13.1/lib/node_modules/wrangler/templates/middleware/middleware-miniflare3-json-error.ts:22:10)
    at async drainBody (file:///home/proman4713/.nvm/versions/node/v22.13.1/lib/node_modules/wrangler/templates/middleware/middleware-ensure-req-body-drained.ts:5:10)