is DALL-E Available on cloudflare? - Cloudflare Developers

© 2026 Hedgehog Software, LLC

More

Communities Docs About Terms Privacy

a4amaan

Aa4amaan is DALL-E Available on cloudflare?

Flask

F

Flask•9/12/24, 6:54 PM

No for Workers AI at the moment, but you could use the OpenAI Endpoint in AI Gateway to make request to OpenAI: https://developers.cloudflare.com/ai-gateway/providers/openai/

Cloudflare Docs

OpenAI | Cloudflare AI Gateway docs

OpenAI

helps you build with ChatGPT.

Flask

FFlask No for Workers AI at the moment, but you could use the OpenAI Endpoint in AI Gat...

a4amaan

A

a4amaanOP•9/12/24, 7:03 PM

ok thanks

user

Uuser `@cf/qwen/qwen1.5-14b-chat-awq` still isnt working with functions, is there any ...

user

U

user•9/13/24, 12:45 AM

Anything?

Ian

I

Ian•9/13/24, 2:20 PM

same with detr-resnet-50, I want to use custom weights

Ian

I

Ian•9/14/24, 1:52 AM

While I am still at the drawing board stage therefore do not want to hit this form. Anyone know if this incurs extra or one-time charges and how expensive they are. I am looking for running yolov8 on workers AI.

cookie

C

cookie•9/14/24, 10:43 PM

is support for json mode planned

user

U

user•9/15/24, 2:21 AM

I keep randomly getting the exception Error in runWithTools: Error in runAndProcessToolCall: Unknown internal errorError in runWithTools: Error in runAndProcessToolCall: Unknown internal error

DoctorU

D

DoctorU•9/15/24, 3:47 AM

How do you find out your usage of workers AI models API? It always shows 0/10,000 neurons for me, although I have sent possibly hundreds of requests.

DoctorU

DDoctorU How do you find out your usage of workers AI models API? It always shows 0/10,00...

user

U

user•9/15/24, 3:48 AM

Youre likely using a beta model

user

Uuser Youre likely using a beta model

DoctorU

D

DoctorU•9/15/24, 3:49 AM

Yes, I am using multiple beta models. Are they not counted?

user

U

user•9/15/24, 3:50 AM

Nope

user

U

user•9/15/24, 3:50 AM

For as long as theyre in beta you have inf usage

DoctorU

D

DoctorU•9/15/24, 3:50 AM

That's really cool! Thanks for clarifying this for me.

Stéphane Magnenat

S

Stéphane Magnenat•9/16/24, 8:23 AM

Hello. Does anyone knows the neuron cost of the model llama-3.1-8b-instruct-awqllama-3.1-8b-instruct-awq? I could not find this information. I am particularly interested in knowing whether that one is significantly cheaper than llama-3.1-8b-instruct-fp8llama-3.1-8b-instruct-fp8. It seems that overall the neuron cost table is not up to date with the model list.

Stéphane Magnenat

S

Stéphane Magnenat•9/16/24, 8:33 AM

Oh I see, sorry for the confusion!

Stéphane Magnenat

S

Stéphane Magnenat•9/16/24, 8:34 AM

Do you know whether there will be a cost difference between the awqawq and the fp8fp8 once they are out of beta? Just to know whether it is worth trying to stick with the smaller weight one during development.

FelikZ

F

FelikZ•9/16/24, 10:49 AM

Hello, do you plan to add "deepseek-coder-v2" anytime soon? Thanks

codebam

Ccodebam 4.20240620.0

acusti

A

acusti•9/17/24, 5:29 PM

@kian i get this same type error with 4.20240909.04.20240909.0, the current most recent version of workers-types. however, i only started getting the error when i migrated from using the now deprecated @cloudflare/ai@cloudflare/ai package to using await env.AI.run(…)await env.AI.run(…) directly, so it seems like the @cloudflare/ai@cloudflare/ai types allow me to use one of the BaseAiTextGenerationModelsBaseAiTextGenerationModels, whereas the types for the direct

AI

AI

binding (which use function overloading for usage with all possible types of AI generation) are, in my case, forcing the modelmodel argument to be type BaseAiImageToTextModelsBaseAiImageToTextModels . i am using typescript v5.6.2.

edit: discord makes it hard to follow the context. the type error i am getting is:

Argument of type '"@cf/meta/llama-3-8b-instruct" | "@hf/thebloke/zephyr-7b-beta-awq" | "@hf/nousresearch/hermes-2-pro-mistral-7b" | "@hf/nexusflow/starling-lm-7b-beta" | "@cf/defog/sqlcoder-7b-2" | "@cf/openchat/openchat-3.5-0106"' is not assignable to parameter of type 'BaseAiImageToTextModels'.

Argument of type '"@cf/meta/llama-3-8b-instruct" | "@hf/thebloke/zephyr-7b-beta-awq" | "@hf/nousresearch/hermes-2-pro-mistral-7b" | "@hf/nexusflow/starling-lm-7b-beta" | "@cf/defog/sqlcoder-7b-2" | "@cf/openchat/openchat-3.5-0106"' is not assignable to parameter of type 'BaseAiImageToTextModels'.

(my code has an enum of models that can be used with retry logic in case one of the models doesn't give a good result)

hari

H

hari•9/19/24, 5:59 AM

what are the ratelimits of workers ai beta models? can you help to understand these limits please?

vin

V

vin•9/19/24, 2:53 PM

here is the document https://developers.cloudflare.com/workers-ai/platform/limits/

Cloudflare Docs

Limits | Cloudflare Workers AI docs

Workers AI is now Generally Available. We’ve updated our rate limits to reflect this.

scotto

S

scotto•9/25/24, 7:37 PM

plans / date to support llama 3.2 3B ?

scotto

S

scotto•9/25/24, 7:37 PM

ideal model for cloudflore (size)

Ashish Rawat

A

Ashish Rawat•9/26/24, 6:21 AM

check here: https://github.com/cloudflare/cloudflare-docs/pull/17119/files

GitHub

Workers AI Birthday Week Updates by mchenco · Pull Request #17119 ·...

Summary
new pricing page and changelog
dash refresh in separate PR
l3.2 in separate PR

Screenshots (optional)

Documentation checklist

[x ] The documentation style guide has been adhered to.

cookie

C

cookie•9/26/24, 6:42 AM

already here https://playground.ai.cloudflare.com/

crazyjack12

C

crazyjack12•9/26/24, 7:45 AM

https://forms.gle/h7FcaTF4Zo5dzNb68 not open yet

Google Forms: Sign-in

Access Google Forms with a personal Google account or Google Workspace account (for business use).

akazwz

A

akazwz•9/26/24, 4:22 PM

Keebs

K

Keebs•9/26/24, 5:21 PM

const response = await env.AI.run("@cf/meta/llama-3.1-8b-instruct", {
        prompt: "What is the origin of the phrase Hello, World",
      });

const response = await env.AI.run("@cf/meta/llama-3.1-8b-instruct", {
        prompt: "What is the origin of the phrase Hello, World",
      });

anyone know why the local example code takes 25 seconds to respond?

Keebs

K

Keebs•9/26/24, 5:34 PM

oh it might be the model

Keebs

K

Keebs•9/26/24, 5:45 PM

no still slow 20 seconds minimum

Keebs

K

Keebs•9/26/24, 5:45 PM

Response time: 716 milliseconds
[wrangler:inf] GET / 200 OK (739ms)

Response time: 716 milliseconds
[wrangler:inf] GET / 200 OK (739ms)

this is when i make a request to groq...

Bibi

B

Bibi•9/26/24, 6:35 PM

Groq doesn’t use gpus so it’s obviously way faster but 25 seconds is indeed quite long

Keebs

K

Keebs•9/26/24, 7:08 PM

well which other api isnt really the issue - cloudflare ai is :D

Keebs

K

Keebs•9/26/24, 7:08 PM

just saying, a remote api request takes 500ms vs cloudflare ai, no matter which model, takes 20+ seconds

Keebs

K

Keebs•9/26/24, 7:08 PM

and im not sure if that is me or if that is normal

Beyondo

B

Beyondo•9/26/24, 7:10 PM

Is it me or did the LLM pricing increase with the newer pricing model? Some models were $0.11 like mixtral, now $0.15 with that new bracket. Anyways, I don't think I'm using Workers AI anytime soon—But I did like a lot of the other updates like no longer being billed for service binding invocations (as it always should've been), so now I'm encouraged to use them rather than package/link every microservice as a library in a single build to avoid the previous anti-microarchitecture model lol.

Keebs

KKeebs just saying, a remote api request takes 500ms vs cloudflare ai, no matter which ...

Beyondo

B

Beyondo•9/26/24, 7:13 PM

I've looked up llama-3.1-8b-instructllama-3.1-8b-instruct, and they seem all beta models. Maybe that's why? Try another model

Keebs

K

Keebs•9/26/24, 7:25 PM

alrady said that, doesnt matter which model

Keebs

K

Keebs•9/26/24, 7:28 PM

(theyre basically all beta)

Keebs

K

Keebs•9/26/24, 7:28 PM

      const response = await env.AI.run("@hf/meta-llama/meta-llama-3-8b-instruct", {
        prompt: "What is the origin of the phrase Hello, World",
      });

      const response = await env.AI.run("@hf/meta-llama/meta-llama-3-8b-instruct", {
        prompt: "What is the origin of the phrase Hello, World",
      });

Keebs

K

Keebs•9/26/24, 7:28 PM

Keebs

K

Keebs•9/26/24, 7:30 PM

Keebs

K

Keebs•9/26/24, 7:30 PM

vs groq (or whichever) api call

Bibi

B

Bibi•9/26/24, 7:35 PM

What about calling it twice? Maybe it’s just the first run taking so long

Bibi

BBibi What about calling it twice? Maybe it’s just the first run taking so long

Keebs

K

Keebs•9/26/24, 7:41 PM

I called it about 30 times by now

Keebs

KKeebs I called it about 30 times by now

Bibi

B

Bibi•9/26/24, 7:46 PM

I mean calling several times in between reloads

Keebs

K

Keebs•9/26/24, 7:46 PM

reloads?

Argument of type '"@cf/meta/llama-3-8b-instruct" | "@hf/thebloke/zephyr-7b-beta-awq" | "@hf/nousresearch/hermes-2-pro-mistral-7b" | "@hf/nexusflow/starling-lm-7b-beta" | "@cf/defog/sqlcoder-7b-2" | "@cf/openchat/openchat-3.5-0106"' is not assignable to parameter of type 'BaseAiImageToTextModels'.

Argument of type '"@cf/meta/llama-3-8b-instruct" | "@hf/thebloke/zephyr-7b-beta-awq" | "@hf/nousresearch/hermes-2-pro-mistral-7b" | "@hf/nexusflow/starling-lm-7b-beta" | "@cf/defog/sqlcoder-7b-2" | "@cf/openchat/openchat-3.5-0106"' is not assignable to parameter of type 'BaseAiImageToTextModels'.