Cloudflare Developers•11mo ago

help emergency pls (cloud flare)

ʙʙʏᴋᴀɢᴀɴ help emergency pls (cloud flare)

MattIPv4•2/18/25, 2:58 PM

You're gonna want to give a bunch more context if you're expecting folks to help

ʙʙʏᴋᴀɢᴀɴ help emergency pls (cloud flare)

Wraith•2/18/25, 3:20 PM

call 911 now bass drop

KKarl Hi everyone, i'm trying to get function calling working on workers ai, but for t...

blindChicken•2/19/25, 2:36 AM

What models have you tried?

blindChicken•2/19/25, 2:42 AM

This tutorial provides a good overview, I've been able to get it to work with LLama3LLama3 and Hermes MistralHermes Mistral. Hermes is used in the tutorial.
https://www.youtube.com/watch?v=Id5oKCa__IA
I have not be able to get it to work with deepseek-r1deepseek-r1

YouTubeCloudflare Developers

Tool Calling Also Known as Function Calling on Cloudflare Workers AI

Tool calling, also known as function calling, is a powerful concept that lets you build Large Language Model based applications that can perform actions and retrieve external information from defined tools.

Repo: https://github.com/craigsdennis/lightbulb-moment-tool-calling

Sign up for Cloudflare for free!!
https://workers.cloudflare.com/

#cl...

Giovanni Cocco•2/19/25, 1:02 PM

Hey everyone! is anyone using Worker AI with OpenWeb UI?

KKarl @blindChicken ; i got it _mostly_ working with llama 3.1 still does some funky ...

blindChicken•2/19/25, 2:46 PM

For tool calling I find that HermesHermes performs best. It produce reliable results, but even it can at times provide a messed up response (but it is rare).

BBumblebeeSquare Empty message

Raylight•2/21/25, 10:19 PM

As a follow-up, support for usage stats have now been added to the workers-ai-provider package.

Jumaron•2/22/25, 3:44 PM

Hello, would it be possible that CloudFlare adds Zonos from Zyphra for a Voice Model? It is open Source under the Apache License, so it should fit perfectly to Cloudflare.

ANBU•2/23/25, 6:20 PM

Hey, anyone faced this issue where worker ai stops responding in mid of sentence?

AANBU Hey, anyone faced this issue where worker ai stops responding in mid of sentence...

LeakyAssassin•2/23/25, 6:22 PM

it's fake ai. :D. what do you expect. Usually its from overload of tokens though.

AANBU Hey, anyone faced this issue where worker ai stops responding in mid of sentence...

kian•2/23/25, 7:25 PM

max_tokens defaults to 256, you’re probably hitting that many output tokens so it’ll stop

LLeakyAssassin it's fake ai. :D. what do you expect. Usually its from overload of tokens thou...

ANBU•2/23/25, 7:48 PM

Yeah with this thinking models like deepseek are basically unusable

Kkian max_tokens defaults to 256, you’re probably hitting that many output tokens so i...

ANBU•2/23/25, 8:21 PM

Is there a way to increase this limit?

ANBU•2/23/25, 9:49 PM

My bad, missed that in the docs

ANBU•2/23/25, 9:49 PM

Thanks!

Ben-xD•2/24/25, 9:58 AM

Does it make sense to a workers AI image-to-text use for image content moderation? Or should i avoid workers AI for that

mr.niko.la•2/25/25, 4:29 AM

Faster Latency sorry not sure if that is faster response or slower response times. I assume you mean faster.

Maybe I should run a container on my server when I can. Justify the cost to run a server

Mmr.niko.la Faster Latency sorry not sure if that is faster response or slower response time...

Isaac McFadyen•2/25/25, 4:43 AM

Latency of Groq is almost certainly going to be faster in this case.

Florencia•2/25/25, 5:29 AM

@Isaac McFadyen

Original message was deleted

DragoDiKomo•2/25/25, 1:49 PM

I tried too to set manually the max context length but still cutting the responses

jLynx•2/25/25, 7:37 PM

We have thousands of users of our service complaining because the users LLM requests are being blocked when trying to use Anthropic from a supported country using the AI gateway through a CF Worker, but the issue is they are being routed through a HK server (Which is not supported by anthropic), so the users end up getting blocked. What can we do here to fix this critical issue @Walshy | Workers/Pages ?
We are in talks with Anthropic about this too

JjLynx We have thousands of users of our service complaining because the users LLM requ...

Isaac McFadyen•2/25/25, 8:02 PM

Please don't ping employees, Walshy isn't on the AI team so wouldn't be able to resolve this anyway.

IIsaac McFadyen Please don't ping employees, Walshy isn't on the AI team so wouldn't be able to ...

jLynx•2/25/25, 8:03 PM

Sorry, its related to workers/pages too

Isaac McFadyen•2/25/25, 8:04 PM

Walshy specifically works on the Worker deployment team so isn't able to help here. I've sent this to someone on the AI Gateway team though.

IIsaac McFadyen Walshy specifically works on the Worker deployment team so isn't able to help he...

jLynx•2/25/25, 8:04 PM

Appreciate that @Isaac McFadyen

stochastic•2/26/25, 3:24 AM

Are there any distributed tracing products that work with Workers AI such that I can see spans and waterfalls?

Nimesh•2/26/25, 5:02 AM

Hi, congratulations on the Agents SDK launch. I checked the source code and it looks like it’s based on Durable Objects and one of the examples makes a fetch request to an AI provider, but aren’t Durable Objects charged based on wall time? Makes me wonder if DOs are really suited for these long running AI requests from a pricing point of view. Is this expected to change anytime soon?

rob•2/26/25, 1:11 PM

I love agents

NNimesh Hi, congratulations on the Agents SDK launch. I checked the source code and it l...

Zetax•2/26/25, 2:42 PM

Would love to know this as well

Aster•2/26/25, 3:47 PM

Hey, do you know if there would be MCP support any time soon

AAster Hey, do you know if there would be MCP support any time soon 🙂 ?

DutchDelite (Ivo)•2/26/25, 3:50 PM

+1 on this one

Original message was deleted

Isaac McFadyen•2/26/25, 4:28 PM

In a recent patch, they removed the systemsystem role from llama-guard-3-8bllama-guard-3-8b since it wasn't intended to be allowed but it seems they forgot to update the playground

IIsaac McFadyen Walshy specifically works on the Worker deployment team so isn't able to help he...

jLynx•2/26/25, 8:21 PM

Morning Isaac, any update from the team?

JjLynx Morning Isaac, any update from the team?

Isaac McFadyen•2/26/25, 8:31 PM

I haven't heard anything, sorry.

kfcvivo50q•2/27/25, 5:51 AM

hey guys,I noticed that the response from workers-ai/models/deepseek-r1-distill-qwen-32b is incomplete; it only provides a brief answer before being cut off. Is this a normal occurrence, or could there be an issue with my settings?

rufi•2/27/25, 1:24 PM

Hello - I tried the agents-starter (following yesterday's launch / blog post) and both locally and when deployed, following the instructions, the "agent" never respond to inputs. Any cues? Thanks

Kkfcvivo50q hey guys,I noticed that the response from workers-ai/models/deepseek-r1-distill-...

Isaac McFadyen•2/27/25, 1:45 PM

There was a recent change to start enforcing max_tokens in the API. If you want it to respond with more than 256 tokens then you'll need to specify max_tokensmax_tokens yourself.

drdiffie•2/27/25, 1:54 PM

Is it possible to use custom Models which are not listed in the "Models"? Would love to see Phi-4 multimodal.

Isaac McFadyen•2/27/25, 2:00 PM

?workers-ai-models

SuperHelpflare•2/27/25, 2:00 PM

Workers AI currently only supports popular open-source models provided by the Cloudflare team, as well as your own LoRAs that can be applied on top of the Cloudflare-provided models. You cannot currently upload your own models or use a model from HuggingFace. See the documentation for the list of Cloudflare-provided models: https://developers.cloudflare.com/workers-ai/models/

Isaac McFadyen•2/27/25, 2:00 PM

^ TLDR no, not at the moment

drdiffie•2/27/25, 2:11 PM

Sad.

IIsaac McFadyen There was a recent change to start enforcing max_tokens in the API. If you want ...

kfcvivo50q•2/27/25, 3:19 PM

thx

Keebs•2/27/25, 8:09 PM

anyone talk yet about the agents?

help emergency pls (cloud flare)

Similar Threads

Similar Threads

Similar Threads