What's the pricing for neurons on text to image generation? - Cloudflare Developers

© 2026 Hedgehog Software, LLC

More

Communities Docs About Terms Privacy

user

Uuser i dont see where the "prompt" property would come in as I don't see that documen...

Raylight

R

Raylight•8/2/24, 9:05 PM

These error messages can be quite cryptic. Omitting the property "type" inside a single parameter of a single tool would produce the same error, for example. In your example with parameters: {}parameters: {} I got past the error by changing it to parameters: { type: "object", properties: {} }parameters: { type: "object", properties: {} }.

Raylight

RRaylight These error messages can be quite cryptic. Omitting the property "type" inside a...

user

U

user•8/2/24, 9:07 PM

Interesting.

user

U

user•8/2/24, 9:07 PM

That is very cryptic indeed

user

U

user•8/2/24, 9:07 PM

I feel like this is definitely an issue with upstream

AWTom

A

AWTom•8/3/24, 10:57 PM

I see that four of the text generation models support LoRA adapters. Is LoRA support for text-to-image models currently in the works?

heloo_mrinal

H

heloo_mrinal•8/4/24, 10:28 AM

hey this side mrinal I have a prior project on cloudflare using workers-ai, but when started with another project using ai it showed me the there is likely additional logging output above

heloo_mrinal

H

heloo_mrinal•8/4/24, 11:22 AM

any soution for that ?

ring0

R

ring0•8/5/24, 10:46 PM

Anyone know of a full (working) example project with supporting files for an AI worker utilizing OpenAI tool usage? Not just a snippet that assumes everything else is gtg. So far my project is pretty capable of generating frustration and 500 errors.

oakwhiz

Ooakwhiz What's the pricing for neurons on text to image generation?

Kathy

K

Kathy•8/6/24, 5:49 PM

All our text-to-image models are currently in beta, which means they are free to use until they graduate from beta
https://developers.cloudflare.com/workers-ai/models/#text-to-image

Cloudflare Docs

Models · Cloudflare Workers AI docs

Browse our entire catalog of models:

AWTom

AAWTom I see that four of the text generation models support LoRA adapters. Is LoRA sup...

Kathy

K

Kathy•8/6/24, 5:51 PM

is there a specific model you are interested in using LoRAs with?

Crystal Shardz

C

Crystal Shardz•8/7/24, 2:31 PM

Hi, I have written a Vue 3 app which uses Vite to talk to the Llama AI worker. This works fine when running locally via the vite dev server as I am using a proxy however, after deploying to Cloudflare Pages, my requests are no longer proxied via the Vite dev server so the requests are going to the Llama AI but the OPTIONS request comes back with a 400 error. Any ideas how I can get this working correctly? Appologies if this needs posing in the Pages section of Discord - it's cross product so felt this was a better place as the issue is with talking from CF Pages to the CF AI

Beyondo

B

Beyondo•8/8/24, 1:46 AM

Is there a way to specify stop tokens? This is very important to me cause I mainly will be using the rawraw parameter

Raylight

RRaylight These error messages can be quite cryptic. Omitting the property "type" inside a...

user

U

user•8/8/24, 4:14 AM

Were you able to get the functions to actually execute with the model?

user

U

user•8/8/24, 4:15 AM

because I'm still unable to do so lol

user

Uuser Were you able to get the functions to actually execute with the model?

Raylight

R

Raylight•8/8/24, 9:57 AM

With qwen? no. I don't think qwen is supported. I would like to see Cloudflare add support for "stop words" so that I can implement it myself.

Wouter J

W

Wouter J•8/8/24, 9:57 AM

Hey all, any chance CF is working on a Background Removal from image integration? e.g. @imgly/background-removal-node.

I'd love to use it in a worker, but since it's downloading models on the fly (edit: oh for prod you can serve the models statically, but still not possible/ a good thing to do in a Worker I think) I need to implement it in my NodeJS API.

So was just wondering if there was anything in the pipeline for it. Keep rocking.

Korcan

KKorcan `InferenceUpstreamError: undefined: undefined` ``` at Ai._parseError (cloudflare...

Aleksandar

A

Aleksandar•8/8/24, 2:42 PM

Hello. Was this issue with InferenceUpstreamError: undefined: undefinedInferenceUpstreamError: undefined: undefined fixed? I'm getting the same error using @cf/microsoft/resnet-50@cf/microsoft/resnet-50 with a PNG and this code https://gist.github.com/net-tech/0eb5e0caa05c6be931ab373cbb35f360

Gist

Code + error on CF workers AI

Code + error on CF workers AI. GitHub Gist: instantly share code, notes, and snippets.

SeanShan

SSeanShan can anyone help me with this since our service relies on this

Isaac McFadyen

I

Isaac McFadyen•8/8/24, 5:42 PM

Workers AI/Cloudflare won't have any control of this, if it did happen (not sure if it will) it would be due to the underlying model which is Intel/distilbert-base-uncased-finetuned-sst-2-english-int8-static-incIntel/distilbert-base-uncased-finetuned-sst-2-english-int8-static-inc and how it's been trained.

Alex Potemkin

A

Alex Potemkin•8/10/24, 10:46 AM

Hey, I wonder how I can be notified when specific AI models on AI workers will be out of beta?

Aleksandar

AAleksandar Hello. Was this issue with `InferenceUpstreamError: undefined: undefined` fixed?...

Aleksandar

A

Aleksandar•8/10/24, 11:53 AM

Can anyone help with this

anywhichway

A

anywhichway•8/10/24, 2:14 PM

I have a really basic AI request:

export async function onRequest(context) {
    const input = { prompt: "What is the origin of the phrase Hello, World" }
    const answer = await context.env.AI.run('@cf/meta/llama-3.1-8b-instruct', input);
    return Response.json(answer);
}

export async function onRequest(context) {
    const input = { prompt: "What is the origin of the phrase Hello, World" }
    const answer = await context.env.AI.run('@cf/meta/llama-3.1-8b-instruct', input);
    return Response.json(answer);
}

The function gets called (I can put a debugger break in dev tools ). The AI run never seems to return and I ultimately get the error below. I have authorized wrangler to access my account and confirmed the AI is bound in wrangler.toml:

A ReadableStream branch was created but never consumed. Such branches can be created, for instance, by calling the tee() method on a ReadableStream, or by calling the clone() method on a Request or Response object. If a branch is created but never consumed, it can force the runtime to buffer the entire body of the stream in memory, which may cause the Worker to exceed its memory limit and be terminated. To avoid this, ensure that all branches created are consumed.

A ReadableStream branch was created but never consumed. Such branches can be created, for instance, by calling the tee() method on a ReadableStream, or by calling the clone() method on a Request or Response object. If a branch is created but never consumed, it can force the runtime to buffer the entire body of the stream in memory, which may cause the Worker to exceed its memory limit and be terminated. To avoid this, ensure that all branches created are consumed.

Muhammadreza Haghiri

M

Muhammadreza Haghiri•8/10/24, 5:21 PM

Hey guys, what is up?
I'm curious, is there a way to request to add a model to the list? I'm just looking for opportunities for my models to be added to public lists/tools such as workers AI.

thipperz

T

thipperz•8/10/24, 7:21 PM

A good Image Embedding model someday...? Would fit so nicely with Vectorize wouldn't it?

Aleksandar

AAleksandar Can anyone help with this

Raylight

R

Raylight•8/11/24, 9:20 AM

I can't reproduce "undefined: undefined" but haven't tried running locally. That said, make sure that the image is smaller than 2.5-3 MB. (JSON.stringify(inputs).lengthJSON.stringify(inputs).length needs to be less than 9.5 MB, to be precise.)

JCBahn

J

JCBahn•8/11/24, 9:32 AM

When I make a query in a non-English language, the response comes out broken. Has anyone else experienced this? This doesn't happen when I use llama3.1 with ollama. Please improve support for non-English queries. Especially for Llama 3.1.

Raylight

RRaylight I can't reproduce "undefined: undefined" but haven't tried running locally. That...

Aleksandar

A

Aleksandar•8/11/24, 12:12 PM

that was happening locally. ill check the image size and get back to you

shellsort

S

shellsort•8/11/24, 12:34 PM

Heyhey!
I was wondering if/when the documentation for this endpoint will be updated:
https://developers.cloudflare.com/api/operations/workers-ai-post-run-model

The responses are not correct.
Successful responses return more than result, they also return a success, errors and messages code where I can only assume that the errors and messages content is strings (thou it might very well be status codes of some sort) and the result contains a model-specific response.

For example for the M2M100-1.2B translation model it is translated_text (which is somewhat documented in the api schema definition of the worker: https://developers.cloudflare.com/workers-ai/models/m2m100-1.2b/)
For unsuccessful responses thou, the result is really weird. On wrong input I got this for example:
{
"result": {
"translated_text": "ERROR: invalid source_lang (English)"
},
"success": true,
"errors": [],
"messages": []
}

which is, very confusing and odd to use. It says success, even thou there's an error. The errors section is empty. The messages section is empty and the message itsself is in the model result. :/

It is also unclear which input values for this model are allowed.
I found this (https://github.com/cloudflare/cloudflare-docs/blob/production/content/workers-ai/models/m2m100-1.2b.md), but it doesnt seem to list all languages.
I also found this (https://github.com/ikergarcia1996/Easy-Translate/blob/main/supported_languages.md#supported-languages-m2m100), but the cloudflare version only seems to work with flatcase conventions and the "ld" abbreviations. It's also unclear if these abbreviations follow ISO 639, some other standard or if they are arbitrary.

Cloudflare API Documentation

Interact with Cloudflare's products and services via the Cloudflare API

GitHub

Easy-Translate/supported_languages.md at main · ikergarcia1996/Easy...

Easy-Translate is a script for translating large text files with a SINGLE COMMAND. Easy-Translate is designed to be as easy as possible for beginners and as seamlesscustomizable and as possible fo...

Treetop

T

Treetop•8/11/24, 4:27 PM

Does anyone know the pricing for whisper-tiny-en?

Devon

D

Devon•8/11/24, 10:03 PM

is there any support for dialects in the translation AI model? Standard locale codes don't seem to be valid. Things like Brazilian Portuguese or the Hong Kong or Tawainese variants of Chinese.

shellsort

Sshellsort Heyhey! I was wondering if/when the documentation for this endpoint will be upda...

shellsort

S

shellsort•8/12/24, 12:53 AM

There's a list of supported languages in here somewhere

Devon

D

Devon•8/12/24, 12:28 PM

Oh I hadn't seen your comment previously. Yeah I couldn't find a list. It does seem like, contrary to most of the docs, that it only takes lowercase two char codes. Not wanting to look a gift horse in the mouth, but have the ability to translate Portugal Portugese and Brazil Portugese separately would be very nice (along with the variants of zh, etc... )

shellsort

S

shellsort•8/12/24, 2:21 PM

Full names work for me.

shellsort

S

shellsort•8/12/24, 2:21 PM

lowercase

Devon

D

Devon•8/12/24, 2:57 PM

ah, I've been using the two letter codes successfully. but no "pt_BR" or "zh_TW" etc...

kian

K

kian•8/12/24, 3:26 PM

https://developers.cloudflare.com/turnstile/reference/supported-languages/#supported-languages

kian

K

kian•8/12/24, 3:26 PM

zh-twzh-tw and pt-brpt-br

Devon

D

Devon•8/12/24, 3:30 PM

Doesn't work for the Translation AI: "ERROR: invalid target_lang (zh-tw)"

kian

K

kian•8/12/24, 3:46 PM

Oops, I thought I was in the Turnstile channel.

kian

K

kian•8/12/24, 3:46 PM

In that case, all of the languages supported by the model should be on https://huggingface.co/facebook/m2m100_1.2B#languages-covered which indeed doesn't cover dialects.

Devon

D

Devon•8/12/24, 3:47 PM

ah, thank you very much!

bradyjoslin

Bbradyjoslin Recommend adding the function calling pill visualization to llama-3.1-8b-instruc...

Craig Dennis

C

Craig Dennis•8/12/24, 9:35 PM

We're still working out the kinks before we add the pill, but thank you for the specific and thoughtful callout!

anirudh

A

anirudh•8/13/24, 10:37 AM

Which version of Whisper is Workers AI using? V2 large or V3 large?

export async function onRequest(context) {
    const input = { prompt: "What is the origin of the phrase Hello, World" }
    const answer = await context.env.AI.run('@cf/meta/llama-3.1-8b-instruct', input);
    return Response.json(answer);
}

export async function onRequest(context) {
    const input = { prompt: "What is the origin of the phrase Hello, World" }
    const answer = await context.env.AI.run('@cf/meta/llama-3.1-8b-instruct', input);
    return Response.json(answer);
}

A ReadableStream branch was created but never consumed. Such branches can be created, for instance, by calling the tee() method on a ReadableStream, or by calling the clone() method on a Request or Response object. If a branch is created but never consumed, it can force the runtime to buffer the entire body of the stream in memory, which may cause the Worker to exceed its memory limit and be terminated. To avoid this, ensure that all branches created are consumed.

A ReadableStream branch was created but never consumed. Such branches can be created, for instance, by calling the tee() method on a ReadableStream, or by calling the clone() method on a Request or Response object. If a branch is created but never consumed, it can force the runtime to buffer the entire body of the stream in memory, which may cause the Worker to exceed its memory limit and be terminated. To avoid this, ensure that all branches created are consumed.