does any one know how to create workers ai resources using pulumi? - Cloudflare Developers

© 2026 Hedgehog Software, LLC

More

Communities Docs About Terms Privacy

Ray Li

R

Ray LiOP•10/8/24, 4:36 AM

Couldn't find it on the docs, seems like we have to use wrangler?

Keebs

K

Keebs•10/8/24, 8:28 PM

Ray Li

RRay Li does any one know how to create workers ai resources using pulumi?

Keebs

K

Keebs•10/8/24, 8:29 PM

https://developers.cloudflare.com/pulumi/tutorial/hello-world/

Atinux

A

Atinux•10/9/24, 1:37 PM

I made an open source template to generate image using Flux-1 Schnell & R2 to store generated images
https://github.com/atinux/flux-ai-image-generator

GitHub

GitHub - atinux/flux-ai-image-generator: Generate images with AI us...

Generate images with AI using Flux-1 Schnell running on your Cloudflare account. - atinux/flux-ai-image-generator

Atinux

A

Atinux•10/9/24, 1:37 PM

I have a question regarding the options, is it possible to specify the

width

width

&

height

height

of the image?

Atinux

A

Atinux•10/9/24, 1:38 PM

I know that Together AI can support this but I rather use Cloudflare and wanted to know if this will be possible

Atinux

AAtinux I made an open source template to generate image using Flux-1 Schnell & R2 to st...

Advany

A

Advany•10/9/24, 1:38 PM

No they removed all options

Advany

AAdvany No they removed all options

Atinux

A

Atinux•10/9/24, 1:38 PM

Do you know why?

Atinux

AAtinux Do you know why?

Advany

A

Advany•10/9/24, 1:51 PM

No. I just saw a update github for the docs

Advany

A

Advany•10/10/24, 7:29 PM

Finally got the hang of prompting flux schnell. Really loving it!

Phanindra Reddy

P

Phanindra Reddy•10/11/24, 2:39 AM

Hey guys, when I am trying to access the llama 3.2 model, it is showing me an error of model not found, is it only for me or the model is working?

Advany

AAdvany Finally got the hang of prompting flux schnell. Really loving it!

Phanindra Reddy

P

Phanindra Reddy•10/11/24, 2:39 AM

Any tips?? I just made a image generator for it

orangebrain

Oorangebrain Hi everyone, I'm currently working with the Cloudflare-hosted BAAI model (@cf/ba...

Rihan

R

Rihan•10/11/24, 4:32 AM

I'm experiencing the same issue. Did you manage to find the cause?

Robert

RRobert Hi, I'm using openai python library with cloudflare ai as base. I can pass text ...

Craig Dennis

C

Craig Dennis•10/11/24, 4:38 PM

Just seeing this, do you mean you are using the openai_compat?

Phanindra Reddy

PPhanindra Reddy Any tips?? I just made a image generator for it

Advany

A

Advany•10/11/24, 6:58 PM

prompt the style you like to use

Julius

J

Julius•10/13/24, 4:02 PM

hi guys, i want to ask something about workers ai, i created a Hono app to be deployed on cloudflare worker

I already done to binds the AI in the wrangler.toml, but as i want to access env.AI.run its say

X [ERROR] TypeError: Cannot read properties of undefined (reading 'run')

X [ERROR] TypeError: Cannot read properties of undefined (reading 'run')

Can anyone help me?

Julius

JJulius hi guys, i want to ask something about workers ai, i created a Hono app to be de...

Isaac McFadyen

I

Isaac McFadyen•10/13/24, 4:21 PM

In Hono,

env

env

is on

Isaac McFadyen

I

Isaac McFadyen•10/13/24, 4:21 PM

So it would be c.env.AIc.env.AI

Isaac McFadyen

IIsaac McFadyen So it would be `c.env.AI`

Julius

J

Julius•10/13/24, 4:29 PM

Wow! Thanks a lot for your help! I was new in Hono, i'll be exploring it more :plus1green:

Isaac McFadyen

I

Isaac McFadyen•10/13/24, 4:29 PM

No problem

PRM

P

PRM•10/13/24, 6:46 PM

Hey i am making my portfolio and in that i want ai to give information about the title, like it should generate text in the card by reading the title of the card so is it free on cloudfare?

Flare

F

Flare•10/13/24, 6:49 PM

Please do not post your question in multiple channels/post it multiple times per the rules at ⁠#

welcome-and-rules. It creates confusion for people trying to help you and doesn't get your issue or question solved any faster.

PRM

P

PRM•10/13/24, 6:49 PM

ohkk sry

martinhoest

M

martinhoest•10/13/24, 11:32 PM

I can use @cf/meta/llama-3.2-3b-instruct@cf/meta/llama-3.2-3b-instruct in the playground, but it fails the type checks with latest version of the wranglerwrangler and @cloudflare/workers-types@cloudflare/workers-types packages. I can "cheat" by doing this:

await env.AI.run('@cf/meta/llama-3.2-3b-instruct' as never, {

await env.AI.run('@cf/meta/llama-3.2-3b-instruct' as never, {

It seems weird to couple types to something as dynamic as the models available on the platform...

martinhoest

Mmartinhoest I can use `@cf/meta/llama-3.2-3b-instruct` in the playground, but it fails the t...

PRM

P

PRM•10/13/24, 11:42 PM

hey can u help me

Puliczek

P

Puliczek•10/14/24, 9:40 AM

Is flux-1-schnell cheaper on cloudflare in comparision to fal?

Puliczek

PPuliczek Is flux-1-schnell cheaper on cloudflare in comparision to fal?

Advany

A

Advany•10/14/24, 8:49 PM

Yes. Much cheaper

Danny (Takodan)

D

Danny (Takodan)•10/16/24, 8:36 AM

Hey guys, I'm trying to upload images to Workers AI REST API with Python, but I'm getting error messages. Any tips?

[FDG] H4kuna

[

[FDG] H4kuna•10/16/24, 4:58 PM

Hi, guys, I have a problem and I have a lot of doubts about how I can solve it, and I'm thinking about using supervised learning. Here's the problem: I have a price comparison tool and I need to be validating, buying, identifying products that are identical but with different characteristics, for example, GOD OF WAR = GOD OF WAR 2018 = GOD OF WAR ™, this is one of the examples I've been facing. Can you give me an idea of a tool or something that can help me with this, I'm studying it but I'm extremely lost on how I can do this.

A

ac•10/16/24, 7:19 PM

Hi, I'm having an issue where CF AI has completely stopped working from my local environment (yesterday it was working fine). Not getting any errors or anything, just the AI is obviously not running and not returning anything. Has anything changed with how Cloudflare handles this?

Aac Hi, I'm having an issue where CF AI has completely stopped working from my local...

A

ac•10/16/24, 7:37 PM

To add to this, it is explicility llama-3-8b-instruct. Changing it to a different model (3.1-8b) fixed it. This seems to only happen from my local environment -- production calls to 3-8b seem to still be working fine.

Raylight

R

Raylight•10/17/24, 7:34 AM

Any chance of higher free allocations (i.e. tokens/steps/units per day) on the Workers Paid plan? Like.. something that's more in line with the spirit of the rest of the Workers platform where the limits are (more than) generous enough to build a simple prototype or follow a tutorial.

Looking at the table (https://developers.cloudflare.com/workers-ai/platform/pricing/#free-allocation), taking image generation as example, you'd easily hit 250 steps just to fix a simple bug or help someone out.

[FDG] H4kuna

[[FDG] H4kuna Hi, guys, I have a problem and I have a lot of doubts about how I can solve it, ...

Keebs

K

Keebs•10/17/24, 4:09 PM

identify the main title, offer alternative options to drill down to the user, probably best solution

Keebs

K

Keebs•10/17/24, 4:09 PM

its like "apple iphone" :D

ajgeiss0702

A

ajgeiss0702•10/19/24, 7:47 PM

any idea when the dashboard will be updated to show the new unit of billing?
Also is there any way to get that now?

shoo

S

shoo•10/20/24, 8:42 PM

guys - are beta models still free? (i remember they used to be)
I couldn't find that in documentation anymore

0xPh4s3

0

0xPh4s3•10/21/24, 11:19 AM

Hey guys, I would like to ask whether the LLM in cf worker AI is full precision or quantized, such as LLaMA3.1:70b

fry69

F

fry69•10/21/24, 11:25 AM

?crossposting

Flare

F

Flare•10/21/24, 11:25 AM

Please do not post your question in multiple channels/post it multiple times per the rules at ⁠#

welcome-and-rules. It creates confusion for people trying to help you and doesn't get your issue or question solved any faster.

shoo

Sshoo guys - are beta models still free? (i remember they used to be) I couldn't find ...

Erisa

E

Erisa•10/21/24, 11:41 AM

yes

0xPh4s3

0

0xPh4s3•10/21/24, 11:44 AM

sry

0xPh4s3

0

0xPh4s3•10/21/24, 11:45 AM

:MeowHeartCloudflare:

crazyjack12

C

crazyjack12•10/21/24, 8:26 PM

Any updates on the use any model beta

😈 Donkey 💫

�

😈 Donkey 💫•10/22/24, 11:39 AM

i believe @cf/meta/llama-3.1-8b-instruct-fast in problem, in several days, it usually returns empty answer

Screenshot_2024-10-22_at_18.39.16.jpg

Phanindra Reddy

P

Phanindra Reddy•10/22/24, 4:14 PM

hey guys i am to use llama 3.2 but it is getting an error in workers, how can i use it

Ben-xD

B

Ben-xD•10/22/24, 8:11 PM

is there a way to check the context length of models hosted on cf?

ExploringBildr

E

ExploringBildr•10/23/24, 9:58 AM

Hello, I'm trying to set up Worker AI. I got this {"response":"Content-Type invalid"}
Any thoughts?

ExploringBildr

EExploringBildr Hello, I'm trying to set up Worker AI. I got this {"response":"Content-Type inva...

fry69

F

fry69•10/23/24, 10:11 AM

Check if your AI request works with

curl

curl

and when it does implement it inside the worker. Example request that works for me ->

curl -X POST \
  https://api.cloudflare.com/client/v4/accounts/${CLOUDFLARE_ACCOUNT_ID}/ai/run/@cf/meta/llama-3-8b-instruct \
  -H "Authorization: Bearer ${CLOUDFLARE_API_TOKEN}" \
  -d '{
  "messages": [
    {
      "role": "system",
      "content": "You are a friendly assistant that helps write stories"
    },
    {
      "role": "user",
      "content": "Write a short story about a llama that goes on a journey to find an orange cloud "
    }
  ]
}' \
  | jq

curl -X POST \
  https://api.cloudflare.com/client/v4/accounts/${CLOUDFLARE_ACCOUNT_ID}/ai/run/@cf/meta/llama-3-8b-instruct \
  -H "Authorization: Bearer ${CLOUDFLARE_API_TOKEN}" \
  -d '{
  "messages": [
    {
      "role": "system",
      "content": "You are a friendly assistant that helps write stories"
    },
    {
      "role": "user",
      "content": "Write a short story about a llama that goes on a journey to find an orange cloud "
    }
  ]
}' \
  | jq

ExploringBildr

E

ExploringBildr•10/23/24, 10:30 AM

OK. I got it working

ExploringBildr

E

ExploringBildr•10/23/24, 10:30 AM

Where do I add stream: true, max_tokens: 2048,

curl -X POST \
  https://api.cloudflare.com/client/v4/accounts/${CLOUDFLARE_ACCOUNT_ID}/ai/run/@cf/meta/llama-3-8b-instruct \
  -H "Authorization: Bearer ${CLOUDFLARE_API_TOKEN}" \
  -d '{
  "messages": [
    {
      "role": "system",
      "content": "You are a friendly assistant that helps write stories"
    },
    {
      "role": "user",
      "content": "Write a short story about a llama that goes on a journey to find an orange cloud "
    }
  ]
}' \
  | jq

curl -X POST \
  https://api.cloudflare.com/client/v4/accounts/${CLOUDFLARE_ACCOUNT_ID}/ai/run/@cf/meta/llama-3-8b-instruct \
  -H "Authorization: Bearer ${CLOUDFLARE_API_TOKEN}" \
  -d '{
  "messages": [
    {
      "role": "system",
      "content": "You are a friendly assistant that helps write stories"
    },
    {
      "role": "user",
      "content": "Write a short story about a llama that goes on a journey to find an orange cloud "
    }
  ]
}' \
  | jq