hody jones? - Cloudflare Developers

© 2026 Hedgehog Software, LLC

More

Communities Docs About Terms Privacy

Ben-xD

BBen-xD I noticed my friend has a workers AI page which shows usage, but mine doesn't. M...

Isaac McFadyen

I

Isaac McFadyen•12/8/24, 3:48 AM

If you're only using beta models they won't show usage.

Ben-xD

B

Ben-xD•12/8/24, 3:49 AM

I've been using non-beta models (identical code/commit to my friend, sitting next to them) but mine doesn't show usage. We've been using non-beta models the entire day

Aaron

AAaron hody jones?

Ben-xD

B

Ben-xD•12/8/24, 3:50 AM

What does hody jones mean?

Sadath

S

Sadath•12/9/24, 2:49 PM

Hi , lets say I don't use the ai models hosted by cloudfare and instead import it from somewhere else using workers ai python-sdk . Will the ai inference at edge still happen ?

snoob

S

snoob•12/9/24, 10:08 PM

Has anyone experienced this type error issue for the new models? Im following the tutorial pretty much to a tee thats at https://github.com/craigsdennis/punderful-workflows/tree/main.

It seems i only have access to the old models in autocomplete. Im using the latest @cloudflare/workers-types: ^4.20241205.0.

Tsconfig.json is the same as the punderful tutorial linked above:

{
  "compilerOptions": {
    "target": "ESNext",
    "module": "ESNext",
    "moduleResolution": "Bundler",
    "strict": true,
    "skipLibCheck": true,
    "lib": [
      "ESNext"
    ],
    "types": [
        "@cloudflare/workers-types/experimental"
    ],
    "jsx": "react-jsx",
    "jsxImportSource": "hono/jsx"
  },
}

{
  "compilerOptions": {
    "target": "ESNext",
    "module": "ESNext",
    "moduleResolution": "Bundler",
    "strict": true,
    "skipLibCheck": true,
    "lib": [
      "ESNext"
    ],
    "types": [
        "@cloudflare/workers-types/experimental"
    ],
    "jsx": "react-jsx",
    "jsxImportSource": "hono/jsx"
  },
}

Is this an issue with the Workflows not having the right type definitions?

snoob

S

snoob•12/9/24, 10:46 PM

Im able to run the workflow no problem, Im in a turbo repo so probably messing something up

snoob

S

snoob•12/9/24, 11:01 PM

Oh interesting, the new models dont even work with typescript in that example either. LOL

James

J

James•12/10/24, 8:15 PM

Yeah the Workers AI types are months out of date, but hopefully we'll see an update soon: https://x.com/_mchenco/status/1865865722913841282

michelle (@_mchenco) on X

@CherryJimbo @CloudflareDev its coming! figured out a more sustainable way to do it

Twitter

•

12/8/24, 9:07 PM

zcpbx

Z

zcpbx•12/12/24, 3:33 AM

( I’m new to clourflare AI. ) if the models I am interested in running are not listed is there a way to package/distribute weights for them? Thank you

wuyangwang

W

wuyangwang•12/12/24, 3:51 AM

https://github.com/wuyangwang/my-chat-web/issues/1 The generated image is very abstract, there is a good way to solve?

GitHub

图片生成，workers ai有点抽象，中英文都是 · Issue #1 · wuyangwang/my-chat-web

生成的图片，直呼看不懂

A3 Studio

AA3 Studio Why can't I use workers ai with auth and api gateway? ``` const response = ...

A3 Studio

A

A3 Studio•12/12/24, 6:30 AM

Has anyone solved this

Mitya

M

Mitya•12/12/24, 12:45 PM

What is the rate limit for AI Functions? That's not covered on the rate limits page

or do Functions fall under text generation i.e. 300 reqs per minute? And is that requests as in HTTP requests (whether via the binding or manually)?

zcpbx

Zzcpbx ( I’m new to clourflare AI. ) if the models I am interested in running are not l...

Isaac McFadyen

I

Isaac McFadyen•12/12/24, 2:51 PM

?workers-ai-models Sadly not currently, see below.

SuperHelpflare

S

SuperHelpflare•12/12/24, 2:51 PM

Workers AI currently only supports popular open-source models provided by the Cloudflare team, as well as your own LoRAs that can be applied on top of the Cloudflare-provided models. You cannot currently upload your own models or use a model from HuggingFace. See the documentation for the list of Cloudflare-provided models: https://developers.cloudflare.com/workers-ai/models/

Mitya

MMitya What is the rate limit for AI Functions? That's not covered on the [rate limits ...

Isaac McFadyen

I

Isaac McFadyen•12/12/24, 2:52 PM

Yes to both.

Isaac McFadyen

I

Isaac McFadyen•12/12/24, 2:52 PM

A function call will usually be 1 generation and then if you ask it to do more it'll be more generations

Isaac McFadyen

IIsaac McFadyen A function call will usually be 1 generation and then if you ask it to do more i...

Mitya

M

Mitya•12/12/24, 3:17 PM

Thanks. To be clear, is it true to say that each call to env.AI.runenv.AI.run = 1 request? Or is it more nuanced and comes down to the number of generations, as you alude to?

Mitya

MMitya Thanks. To be clear, is it true to say that each call to `env.AI.run` = 1 reques...

Isaac McFadyen

I

Isaac McFadyen•12/12/24, 3:19 PM

It depends. I'm not super familiar with the Workers AI API—is env.AI.runenv.AI.run just the standard generation mechanism or the Functions one?

Isaac McFadyen

I

Isaac McFadyen•12/12/24, 3:20 PM

If it's the standard generation mechanism then yes, unless you're generating more than 1 generation with a single call it's usually 1:1

Mitya

M

Mitya•12/12/24, 3:22 PM

Thanks. env.AI.runenv.AI.run is for both standard generation and function calls - it's just that, for the latter, you a toolstools object to the params.

SuperHelpflare

SSuperHelpflare Workers AI currently only supports popular open-source models provided by the Cl...

zcpbx

Z

zcpbx•12/13/24, 3:07 AM

Thank you. Is there a place where we can register interest in future models?

Advany

A

Advany•12/13/24, 11:10 AM

has anyone figured out a way to create workflows using ai and deploy them onto worker for platforms?

Advany

AAdvany has anyone figured out a way to create workflows using ai and deploy them onto w...

rob

R

rob•12/14/24, 1:26 PM

I don't think It's supported on wfp yet

rob

R

rob•12/14/24, 1:26 PM

How's everyone doing? How's AI?

user

U

user•12/15/24, 1:47 AM

is anyone able to get image2image working?

user

U

user•12/15/24, 1:47 AM

i have not been able to do it

user

U

user•12/15/24, 2:20 AM

i consistently get api error 3001

user

U

user•12/15/24, 2:21 AM

all the image-to-text models work fine, but if i pass an image to text-to-image i get error 3001

user

U

user•12/15/24, 8:38 PM

ok after some research i figured out its a token issue

user

U

user•12/15/24, 8:38 PM

at strength 2 or something, it runs out of tokens very quickly

Ashley

A

Ashley•12/16/24, 9:36 AM

Is there an easy way to tell the model size for embedding models? For things like Llama (I know not an embedding model) it’s easy, as it has the size in the name. The BGE Large for example, even Googling, I can’t find its size - it would be really helpful to include this on the model’s page on the CF docs, considering the pricing is based on the model size for embedding models.

Ashley

AAshley Is there an easy way to tell the model size for embedding models? For things lik...

Raylight

R

Raylight•12/16/24, 12:05 PM

Regarding pricing, the docs also state that "Individual model pages will have the pricing listed on them", so I'm kinda waiting for that to happen. In any case large is ~335 million parameters, base ~109 million. You can get a rough idea by looking at the file size of the model (e.g. https://huggingface.co/BAAI/bge-large-en-v1.5/tree/main). Going by the "pricing structure", it looks like base and small would fall in the category <= 150 million parameters.

Ashley

A

Ashley•12/16/24, 12:19 PM

Ah cool thank you, I did peek at that page but couldn’t see it but I see it now, thank you!

user

Uuser at strength 2 or something, it runs out of tokens *very* quickly

Raylight

R

Raylight•12/16/24, 12:22 PM

strengthstrength is the fraction of steps where the source image is used, where 1.0 means every step. So it doesn't make sense to set it higher than 1.0. I've noticed that it'll throw an error if you do, however.

user

U

user•12/16/24, 1:30 PM

should return a better error than just “internal server error” though

Bossman

B

Bossman•12/17/24, 11:51 AM

are custom workers ai model supported? i would like to host it myself

Bossman

BBossman are custom workers ai model supported? i would like to host it myself

Chaika

C

Chaika•12/17/24, 2:30 PM

you can't currently upload custom models if that's what you're asking

Chaika

C

Chaika•12/17/24, 2:30 PM

?workers-ai-models

SuperHelpflare

S

SuperHelpflare•12/17/24, 2:30 PM

Workers AI currently only supports popular open-source models provided by the Cloudflare team, as well as your own LoRAs that can be applied on top of the Cloudflare-provided models. You cannot currently upload your own models or use a model from HuggingFace. See the documentation for the list of Cloudflare-provided models: https://developers.cloudflare.com/workers-ai/models/

James

J

James•12/17/24, 10:27 PM

Looks like @cf/openai/whisper-large-v3-turbo@cf/openai/whisper-large-v3-turbo is available now?

James

JJames Looks like `@cf/openai/whisper-large-v3-turbo` is available now? 👀

Isaac McFadyen

I

Isaac McFadyen•12/17/24, 11:16 PM

Yay!

sam

S

sam•12/18/24, 8:59 AM

Is there any way to see the actual pricing of Worker AI? I am using the @cf/baai/bge-large-en-v1.5 model for vector embedding, with each text having 100 input tokens. I ran it for 50000 texts, and based on that, pricing should have been $0.075, but in the worker AI usage dashboard, I see $0.45.

I need to run it for millions of texts and I am worried about getting the huge check at the end

antim8

A

antim8•12/19/24, 4:01 AM

there seem to be models on https://developers.cloudflare.com/workers-ai/models/ that are not usable

Cloudflare Docs

Models · Cloudflare Workers AI docs

Brandon Studio

B

Brandon Studio•12/19/24, 7:31 AM

I'm using messages API body, why it requires promptprompt?

scotto

S

scotto•12/19/24, 7:35 PM

llama-3.3-70b-instruct-fp8-fast is taking 20 sec on avg, that's normal?

velinxs

V

velinxs•12/19/24, 8:38 PM

It's fast relative to CF workers running at edge not so much fast like groq is fast.

Bossman

BBossman are custom workers ai model supported? i would like to host it myself

velinxs

V

velinxs•12/19/24, 8:39 PM

You could use AI gateway

velinxs

V

velinxs•12/19/24, 8:39 PM

I think?

tornado

T

tornado•12/21/24, 2:03 AM

Do AI gateway requests have 100s timeout limitations like other cloudflare workers

{
  "compilerOptions": {
    "target": "ESNext",
    "module": "ESNext",
    "moduleResolution": "Bundler",
    "strict": true,
    "skipLibCheck": true,
    "lib": [
      "ESNext"
    ],
    "types": [
        "@cloudflare/workers-types/experimental"
    ],
    "jsx": "react-jsx",
    "jsxImportSource": "hono/jsx"
  },
}

{
  "compilerOptions": {
    "target": "ESNext",
    "module": "ESNext",
    "moduleResolution": "Bundler",
    "strict": true,
    "skipLibCheck": true,
    "lib": [
      "ESNext"
    ],
    "types": [
        "@cloudflare/workers-types/experimental"
    ],
    "jsx": "react-jsx",
    "jsxImportSource": "hono/jsx"
  },
}