Hi, wanted to ask the community here if there is a combination you find works well together of a Age

Hi, wanted to ask the community here if there is a combination you find works well together of a Agentic Code CLI and a Model from Workers AI specifically. If your familiar with Claude Code, that's what I'm trying to determine if I could build a lower cost cloudflare based version of. Ideas?

PPaul Hi, wanted to ask the community here if there is a combination you find works we...

PaulOP•11/13/25, 4:25 PM

For example I tried combining Aider CLI with Amazon Nova (Not on cloudflare, just an example), and now I'm wonder if I can do the same with Cloudflare hotsed models? - BTW the Aider/Nova combination isn't working too well for me so far

PhoenixSpace•11/13/25, 4:25 PM

IME the cloudflare hosted models tend to be a bit more expensive then other providers. If you want low latency/edge usage, it's great, but if pure cost is your benchmark then other providers will get you a bit better pricing

PPhoenixSpace IME the cloudflare hosted models tend to be a bit more expensive then other prov...

PaulOP•11/13/25, 4:25 PM

Ok, thanks for the insight. I guess I didn't do a cost analysis, for some reason I sort of assumed they would be cheaper on cloudflare

like most stuff

PhoenixSpace•11/13/25, 4:28 PM

If you need to scale and run AI stuff globally/on the edge, their pricing is fantastic. If it’s just a single user internal tool, there are slightly cheaper options

PaulOP•11/13/25, 4:29 PM

I need to get my head around "Neurons" pricing - so I can comapre apples to apples with other solutions.

PhoenixSpace•11/13/25, 4:30 PM

The model pages usually have price per M tokens

PhoenixSpace•11/13/25, 4:30 PM

https://developers.cloudflare.com/workers-ai/models/gpt-oss-120b/

Cloudflare Docs

gpt-oss-120b

OpenAI’s open-weight models designed for powerful reasoning, agentic tasks, and versatile developer use cases – gpt-oss-120b is for production, general purpose, high reasoning use-cases.

Brick_Syntax•11/13/25, 9:52 PM

Hey! so According to chat gpt I can use worker AIs to make my self a AI api, but it says there is limit, it said something about 10,00 neurons per day, now I wanted a better source so is this true? and if so how many neurons per task?

boke0•11/15/25, 12:45 AM

Hi there, I could use some help.
A few days ago, my product, which is built on Cloudflare Workers and integrates with Workers AI (GPT-OSS-120b) through bindings, broke because the interface changed (prompt_tokensprompt_tokens and completion_tokenscompletion_tokens were replaced with input_tokensinput_tokens and output_tokensoutput_tokens).
And today, I ran into another issue: the instructionsinstructions parameter stopped working when the input was in an OpenAI-like format (like [{role: "assistant", content: "foobar" }, ...][{role: "assistant", content: "foobar" }, ...]).

Where can I check for these kinds of interface changes in advance so I can update my product before it breaks?

bayes•11/15/25, 8:41 PM

did someone tested deepgram's nova-3 in workers ai with diarization? always getting timeout regardless of file size or type

KZ•11/16/25, 8:13 PM

is there a channel that has the ball on web-bot-auth specifically the http message signature (9421) is that this group or agents or some other?

samjs•11/17/25, 3:22 PM

https://blog.cloudflare.com/replicate-joins-cloudflare/

The Cloudflare Blog

Replicate is joining Cloudflare

Bringing Replicate’s tools into Cloudflare will continue to make our Workers Platform the best place on the Internet to build and deploy any AI or agentic workflow.

Celestial Rose•11/17/25, 3:29 PM

Holy s*** the Replicate news, CONGRATS !!! Yay to us

Ssamjs https://blog.cloudflare.com/replicate-joins-cloudflare/

LordSilver•11/18/25, 2:32 AM

So... Workers AI = Replicate now? Will you be able to set the GPU model?

LordSilver•11/18/25, 2:33 AM

I've never checked Workers AI vs Replicate pricing for well-known models.

PPhoenixSpace IME the cloudflare hosted models tend to be a bit more expensive then other prov...

zsueo•11/18/25, 11:49 AM

What cheaper options are you referring to, cloudflares paid worker plan is the cheapest I've seen so far

Zzsueo What cheaper options are you referring to, cloudflares paid worker plan is the c...

PhoenixSpace•11/18/25, 1:05 PM

For LLM inference?

PPhoenixSpace For LLM inference?

zsueo•11/18/25, 1:20 PM

Yeah

Zzsueo Yeah

PhoenixSpace•11/18/25, 2:18 PM

Google vertex and Amazon bedrock running the same model is usually a bit cheaper, same with fireworks AI and deepinfra

PhoenixSpace•11/18/25, 2:19 PM

Similar in pricing is groq (not to be confused with grok!) but faster output

PhoenixSpace•11/18/25, 2:19 PM

This is why I’m stoked about Replicate, I think this is gonna be huge

Original message was deleted

QuentinCody•11/18/25, 2:30 PM

Yes, I'm working on a chatbot+MCP Client that comes pre-loaded with custom MCP Servers I've built

Vivek_m4_•11/20/25, 6:06 AM

Hi, I built a huge AI tool using Cloudflare Workers (Spider AI).
I want to discuss potential collaboration or GPU credits.
Whom should I contact from the Cloudflare team?

Bblah Requesting help with my community help request: "Request AI Streaming Binding Ac...

Vivek_m4_•11/20/25, 6:19 AM

export default {
async fetch(req, env) {
const model = "@cf/meta/llama-2-7b-chat-int8";

const stream = await env.DOCTALK_AI.run(model, {
prompt: "What is a tomato?",
stream: true,
});

return new Response(stream, {
headers: {
"Content-Type": "text/event-stream",
},
});
},
};
Hello bro this is correct code

vcc•11/21/25, 7:37 AM

fetch(`https://api.cloudflare.com/client/v4/accounts/${this.env.CF_ACCOUNT}/ai/run/@cf/deepgram/nova-3?${new URLSearchParams({
            encoding: 'linear16',
            sample_rate: '16000',
                        language:  ?
}).toString()}`)

fetch(`https://api.cloudflare.com/client/v4/accounts/${this.env.CF_ACCOUNT}/ai/run/@cf/deepgram/nova-3?${new URLSearchParams({
            encoding: 'linear16',
            sample_rate: '16000',
                        language:  ?
}).toString()}`)

Can I specify a language for it? and how many languages support it?

VVivek_m4_export default { async fetch(req, env) { const model = "@cf/meta/llama-2-7...

blah•11/21/25, 5:43 PM

Thanks Vivek

Ahmed bat•11/21/25, 6:09 PM

Image models return 0 bytes but text models work

Ahmed bat•11/21/25, 6:10 PM

hey there im trying to use leonardo ai to create images from cloudflare workers ai ... i ve tested it on my n8n workflow it wroks good with other models but with leonardo models i ve got thiserror : Image models return 0 bytes but text models work

Catkin038•11/22/25, 10:24 AM

Hello everyone, my Workers AI returned Error 1101, and the reason in the statistics is Uncaught Exception. How should I troubleshoot this?

Catkin038•11/22/25, 10:39 AM

I found the problem, 5028: This model was deprecated on 2025-10-01. Please use an alternative model.

Catkin038•11/22/25, 10:42 AM

I need to confirm whether @cf/qwen/qwen2.5-coder-32b-instruct still accepts support.

Original message was deleted

Catkin038•11/22/25, 10:42 AM

Thank you

Catkin038•11/22/25, 10:42 AM

I have left that server because I found it to be new people, not any official

Catkin038•11/22/25, 10:46 AM

Why did he deceive me? Even if I mistakenly joined that server, I should have been able to realize it was fake quickly.

Catkin038•11/22/25, 10:53 AM

Hello everyone, I've noticed that my Workers AI sometimes encounters the 5028 issue, but querying @cf/qwen/qwen2.5-coder-32b-instruct is still supported. After receiving an email in September, I updated the model referenced in my code. Is it possible that some of Cloudflare's data centers are not using the latest code?

plutch•11/22/25, 1:40 PM

Support request for code embedding model SFR-Embedding-Code or CodeSage-Large-v2

Razmjoo•11/22/25, 5:09 PM

Hi, I am using the batch api for the Markdown API; I am getting a 50% error rate when converting images to Markdown. I am using 10/batch and 10/concurrent requests. example errors I am getting:

{'name': '123_image_5.png', 'mimeType': 'image/png', 'format': 'error', 'error': 'Error converting image to markdown text: 3040: Capacity temporarily exceeded, please try again.'}

{'name': '123_image_5.png', 'mimeType': 'image/png', 'format': 'error', 'error': 'Error converting image to markdown text: 3040: Capacity temporarily exceeded, please try again.'}

shotan•11/23/25, 11:42 PM

Hi, I'm using the OpenAI api for embeddings and getting a lot of 500 errors with the qwen3-embedding-0.6b model. Around 100 requests per minute, 20 inputs per batch, small chunks. Seems ok for 5 minutes then the errors start to pile up. My app handles 3 retries.

blah•11/24/25, 3:50 PM

Hey Cloudflare AI team / #workers-ai,
We're hitting a wall with high Time-to-First-Token (TTFT) latency on one of our streaming applications using Workers AI. Need some insight if this is expected for the model we're using.

The Problem:
Our application is experiencing an approx 4.0 second delay before the LLM starts streaming any output.

Our Setup:
Model: @cf/meta/llama-3.1-8b-instruct-fp8
Worker Region: MIA (Miami)
Prompt Size: approx 1,144 input characters (RAG context).Worker Performance:Total Wall Time: 4,474 ms
Worker CPU Time: 16 ms
(Conclusion: Almost all time is spent waiting on the model to start generation, not our code.)

Questions:
Is a 4.0+ second TTFT common for the llama-3.1-8b-instruct model at this prompt length?
Are there specific provisioning tips, or is the *-fast variant recommended solely for reducing this TTFT?

Any advice on further optimizing TTFT on Workers AI is appreciated!

Thanks!

Ssamjs Hey @Fabian . Streaming for the gpt-oss models is not currently supported, but w...

acusti•11/24/25, 4:04 PM

just checking in on this. is streaming supported yet for the gpt-oss models? i actually thought until i happened to come across this message that it was supported, at least when using the workers AI binding, based on this message thread: workers-ai

Celestial Rose•11/24/25, 9:56 PM

loving the new Models page ! step in the right direction, now we just miss better capabilities !

Celestial Rose•11/25/25, 4:47 PM

kinda lost, isnt flux2dev a year old ?