https://blog.cloudflare.com/replicate-joins-cloudflare/

The Cloudflare Blog

Bringing Replicate’s tools into Cloudflare will continue to make our Workers Platform the best place on the Internet to build and deploy any AI or agentic workflow.

Celestial Rose•11/17/25, 3:29 PM

Holy s*** the Replicate news, CONGRATS !!! Yay to us

Ssamjs https://blog.cloudflare.com/replicate-joins-cloudflare/

LordSilver•11/18/25, 2:32 AM

So... Workers AI = Replicate now? Will you be able to set the GPU model?

LordSilver•11/18/25, 2:33 AM

I've never checked Workers AI vs Replicate pricing for well-known models.

PPhoenixSpace IME the cloudflare hosted models tend to be a bit more expensive then other prov...

zsueo•11/18/25, 11:49 AM

What cheaper options are you referring to, cloudflares paid worker plan is the cheapest I've seen so far

Zzsueo What cheaper options are you referring to, cloudflares paid worker plan is the c...

PhoenixSpace•11/18/25, 1:05 PM

For LLM inference?

PPhoenixSpace For LLM inference?

zsueo•11/18/25, 1:20 PM

Yeah

Zzsueo Yeah

PhoenixSpace•11/18/25, 2:18 PM

Google vertex and Amazon bedrock running the same model is usually a bit cheaper, same with fireworks AI and deepinfra

PhoenixSpace•11/18/25, 2:19 PM

Similar in pricing is groq (not to be confused with grok!) but faster output

PhoenixSpace•11/18/25, 2:19 PM

This is why I’m stoked about Replicate, I think this is gonna be huge

Original message was deleted

QuentinCody•11/18/25, 2:30 PM

Yes, I'm working on a chatbot+MCP Client that comes pre-loaded with custom MCP Servers I've built

Vivek_m4_•11/20/25, 6:06 AM

Hi, I built a huge AI tool using Cloudflare Workers (Spider AI).
I want to discuss potential collaboration or GPU credits.
Whom should I contact from the Cloudflare team?

Bblah Requesting help with my community help request: "Request AI Streaming Binding Ac...

Vivek_m4_•11/20/25, 6:19 AM

export default {
async fetch(req, env) {
const model = "@cf/meta/llama-2-7b-chat-int8";

const stream = await env.DOCTALK_AI.run(model, {
prompt: "What is a tomato?",
stream: true,
});

return new Response(stream, {
headers: {
"Content-Type": "text/event-stream",
},
});
},
};
Hello bro this is correct code

vcc•11/21/25, 7:37 AM

fetch(`https://api.cloudflare.com/client/v4/accounts/${this.env.CF_ACCOUNT}/ai/run/@cf/deepgram/nova-3?${new URLSearchParams({
            encoding: 'linear16',
            sample_rate: '16000',
                        language:  ?
}).toString()}`)

fetch(`https://api.cloudflare.com/client/v4/accounts/${this.env.CF_ACCOUNT}/ai/run/@cf/deepgram/nova-3?${new URLSearchParams({
            encoding: 'linear16',
            sample_rate: '16000',
                        language:  ?
}).toString()}`)

Can I specify a language for it? and how many languages support it?

VVivek_m4_export default { async fetch(req, env) { const model = "@cf/meta/llama-2-7...

blah•11/21/25, 5:43 PM

Thanks Vivek

Ahmed bat•11/21/25, 6:09 PM

Image models return 0 bytes but text models work

Ahmed bat•11/21/25, 6:10 PM

hey there im trying to use leonardo ai to create images from cloudflare workers ai ... i ve tested it on my n8n workflow it wroks good with other models but with leonardo models i ve got thiserror : Image models return 0 bytes but text models work

Catkin038•11/22/25, 10:24 AM

Hello everyone, my Workers AI returned Error 1101, and the reason in the statistics is Uncaught Exception. How should I troubleshoot this?

Catkin038•11/22/25, 10:39 AM

I found the problem, 5028: This model was deprecated on 2025-10-01. Please use an alternative model.

Catkin038•11/22/25, 10:42 AM

I need to confirm whether @cf/qwen/qwen2.5-coder-32b-instruct still accepts support.

Original message was deleted

Catkin038•11/22/25, 10:42 AM

Thank you

Catkin038•11/22/25, 10:42 AM

I have left that server because I found it to be new people, not any official

Catkin038•11/22/25, 10:46 AM

Why did he deceive me? Even if I mistakenly joined that server, I should have been able to realize it was fake quickly.

Catkin038•11/22/25, 10:53 AM

Hello everyone, I've noticed that my Workers AI sometimes encounters the 5028 issue, but querying @cf/qwen/qwen2.5-coder-32b-instruct is still supported. After receiving an email in September, I updated the model referenced in my code. Is it possible that some of Cloudflare's data centers are not using the latest code?

plutch•11/22/25, 1:40 PM

Support request for code embedding model SFR-Embedding-Code or CodeSage-Large-v2

Razmjoo•11/22/25, 5:09 PM

Hi, I am using the batch api for the Markdown API; I am getting a 50% error rate when converting images to Markdown. I am using 10/batch and 10/concurrent requests. example errors I am getting:

{'name': '123_image_5.png', 'mimeType': 'image/png', 'format': 'error', 'error': 'Error converting image to markdown text: 3040: Capacity temporarily exceeded, please try again.'}

{'name': '123_image_5.png', 'mimeType': 'image/png', 'format': 'error', 'error': 'Error converting image to markdown text: 3040: Capacity temporarily exceeded, please try again.'}

shotan•11/23/25, 11:42 PM

Hi, I'm using the OpenAI api for embeddings and getting a lot of 500 errors with the qwen3-embedding-0.6b model. Around 100 requests per minute, 20 inputs per batch, small chunks. Seems ok for 5 minutes then the errors start to pile up. My app handles 3 retries.

blah•11/24/25, 3:50 PM

Hey Cloudflare AI team / #workers-ai,
We're hitting a wall with high Time-to-First-Token (TTFT) latency on one of our streaming applications using Workers AI. Need some insight if this is expected for the model we're using.

The Problem:
Our application is experiencing an approx 4.0 second delay before the LLM starts streaming any output.

Our Setup:
Model: @cf/meta/llama-3.1-8b-instruct-fp8
Worker Region: MIA (Miami)
Prompt Size: approx 1,144 input characters (RAG context).Worker Performance:Total Wall Time: 4,474 ms
Worker CPU Time: 16 ms
(Conclusion: Almost all time is spent waiting on the model to start generation, not our code.)

Questions:
Is a 4.0+ second TTFT common for the llama-3.1-8b-instruct model at this prompt length?
Are there specific provisioning tips, or is the *-fast variant recommended solely for reducing this TTFT?

Any advice on further optimizing TTFT on Workers AI is appreciated!

Thanks!

Ssamjs Hey @Fabian . Streaming for the gpt-oss models is not currently supported, but w...

acusti•11/24/25, 4:04 PM

just checking in on this. is streaming supported yet for the gpt-oss models? i actually thought until i happened to come across this message that it was supported, at least when using the workers AI binding, based on this message thread: workers-ai

Celestial Rose•11/24/25, 9:56 PM

loving the new Models page ! step in the right direction, now we just miss better capabilities !

Celestial Rose•11/25/25, 4:47 PM

kinda lost, isnt flux2dev a year old ?

CCelestial Rose kinda lost, isnt flux2dev a year old ?

Isaac McFadyen•11/25/25, 8:57 PM

That's FLUX 1

Isaac McFadyen•11/25/25, 8:57 PM

This is FLUX 2

Celestial Rose•11/25/25, 8:57 PM

so whats https://flux2.io/flux2-model-family/

FLUX.2poloz.igor@gmail.com

FLUX2 Model Family

Black Forest Labs offers FLUX.2 in three distinct variants, each tailored for different use cases.

CCelestial Rose so whats https://flux2.io/flux2-model-family/

Isaac McFadyen•11/25/25, 8:59 PM

That's FLUX 2

Isaac McFadyen•11/25/25, 8:59 PM

Which was released today.

Celestial Rose•11/25/25, 8:59 PM

look at the date

Celestial Rose•11/25/25, 8:59 PM

oh sorry its not an official page

Isaac McFadyen•11/25/25, 8:59 PM

That is not the official BFL site, and the information is wrong.

Celestial Rose•11/25/25, 8:59 PM

wth

Celestial Rose•11/25/25, 8:59 PM

dang it

Isaac McFadyen•11/25/25, 8:59 PM

Yeah, there's no Flux 2 Schnell

Isaac McFadyen•11/25/25, 8:59 PM

You want https://bfl.ai/models/flux-2

Celestial Rose•11/25/25, 9:00 PM

awesome thank you

Celestial Rose•11/26/25, 5:15 PM

hey team! i dont see a Email channel yet, where can i request an access for the private beta for Cloudflare Email please ?

CCelestial Rose hey team! i dont see a Email channel yet, where can i request an access for the ...

Isaac McFadyen•11/26/25, 5:16 PM

https://forms.gle/BX6ECfkar3oVLQxs7

Celestial Rose•11/26/25, 5:16 PM

thanks !

Celestial Rose•11/26/25, 5:18 PM

sent

Sb•11/27/25, 3:38 AM

Can I use different models than the current provided.
Like wan 2.2 or veo 3 or other open source model by paying for the compute or neurons?

Sb•11/27/25, 3:41 AM

Cloudflare is already using GPU for other models like flux and llama,
Will they also provide us with the direct usage?

muskan•11/27/25, 9:44 AM

Hi! I wanted to confirm something about Cloudflare AI. Does it support parsing PDF files directly?
Right now, it looks like I must extract the text from the PDF myself before sending it to the AI model. Is there any built-in support (or upcoming support) for uploading a PDF and having the AI read/parse it automatically?

fetch(`https://api.cloudflare.com/client/v4/accounts/${this.env.CF_ACCOUNT}/ai/run/@cf/deepgram/nova-3?${new URLSearchParams({ encoding: 'linear16', sample_rate: '16000', language: ? }).toString()}`)

https://blog.cloudflare.com/replicate-joins-cloudflare/

Similar Threads

Similar Threads

Similar Threads