Any update? - Cloudflare Developers

© 2026 Hedgehog Software, LLC

More

Communities Docs About Terms Privacy

kyle

Kkyle I'm also running into the issue where flex-1-schnell has an overactive nsfw filt...

brylan

B

brylanOP•11/26/24, 3:58 AM

Was told we would get a rix over a month ago, super disappointing

brylan

B

brylanOP•11/26/24, 4:00 AM

brylan

Bbrylan Any update?

DaniFoldi

D

DaniFoldi•11/26/24, 9:00 AM

unfortunately I have no new information, sorry :/

DaniFoldi

DDaniFoldi unfortunately I have no new information, sorry :/

brylan

B

brylanOP•11/27/24, 11:14 PM

Thanks are you even a cloudflare developer?

(Sorry for accusing you or anything)

brylan

B

brylanOP•11/27/24, 11:14 PM

hahah the green role makes you look very official

brylan

Bbrylan Thanks are you even a cloudflare developer? 😔 (Sorry for accusing you or anythi...

DaniFoldi

D

DaniFoldi•11/27/24, 11:15 PM

Green names are not employees, we're community volunteers.

DaniFoldi

D

DaniFoldi•11/27/24, 11:16 PM

with that, I still try my best to find answers, and answer questions to the best of my ability; unfortunately in this case we'd need someone from the team to update us on the status

DaniFoldi

DDaniFoldi with that, I still try my best to find answers, and answer questions to the best...

brylan

B

brylanOP•11/27/24, 11:17 PM

it be whatit be

Logan Grasby

LLogan Grasby Try out this text to speech model ```@cf/myshell-ai/melotts``` With inputs ```{p...

grarich

G

grarich•11/28/24, 2:32 AM

Hi
I want to use this model too.
Please tell me how to use the model to generate Japanese audio.

DaniFoldi

DDaniFoldi with that, I still try my best to find answers, and answer questions to the best...

Isaac McFadyen

I

Isaac McFadyen•11/28/24, 11:54 PM

^ this - we have a number of private channels to the respective teams so we can ask them questions but don't have internal access, so we're generally reliant on them to investigate things internally

Isaac McFadyen

IIsaac McFadyen ^ this - we have a number of private channels to the respective teams so we can ...

0xCC

0

0xCC•11/29/24, 9:49 AM

Hi I used @cf/meta/llama-3-8b-instruct which is suppose to be free but I got alert daily free allocation has been used up?

Logan Grasby

LLogan Grasby To get around this you typically only need to add one or two words to the prompt...

Chaika

C

Chaika•11/29/24, 6:38 PM

yea it just hates short prompts in general, when it first was added there was lots of silly false positives like "elbow" "a elbow" "female" all being blocked for nsfw, didn't recheck but I assume it hasn't changed and would still false flag those, would nice to have the option to disable

codebam

C

codebam•11/29/24, 9:16 PM

how do I see AI usage?

Logan Grasby

LLogan Grasby coming soon!

grarich

G

grarich•11/30/24, 1:13 PM

okay, thank you!

codebam

Ccodebam how do I see AI usage?

Viktor

V

Viktor•11/30/24, 6:09 PM

Wondering the same, according to cloudflare it will "soon" be visible in the dashboard -> https://developers.cloudflare.com/workers-ai/platform/pricing/

Cloudflare Docs

Pricing · Cloudflare Workers AI docs

Workers AI is included in both the Free and Paid Workers plans and is priced based on model task, model size, and units.

joaobcosta

J

joaobcosta•11/30/24, 7:49 PM

Has anyone had any luck transcribing audio and fixing the target language to something other than english? Seems like source_langsource_lang acts more as a suggestion than a rule. Not sure if this is a Cloudflare or a Whisper thing, but figured I'd ask. Relevant snippet:

const inputs = {
          audio: [...new Uint8Array(arrayBuffer)],
          source_lang: 'tr',
          target_lang: 'tr'
        };
const transcriptionResponse = await env.AI.run('@cf/openai/whisper', inputs);

const inputs = {
          audio: [...new Uint8Array(arrayBuffer)],
          source_lang: 'tr',
          target_lang: 'tr'
        };
const transcriptionResponse = await env.AI.run('@cf/openai/whisper', inputs);

Noah-Haf

N

Noah-Haf•12/1/24, 1:08 AM

What's the best way to diagnose the issue that's causing

@hf/meta-llama/meta-llama-3-8b-instruct

@hf/meta-llama/meta-llama-3-8b-instruct

to intermittently return blank responses?

gilxng

G

gilxng•12/1/24, 2:36 PM

Hi @joaobcosta, is there a way to reduce the dimensions size from Resnet50 ?

gilxng

G

gilxng•12/1/24, 2:37 PM

afaik the Resnet50 will create a 2048 dimensions per vector, but the vectorize seems has limitations of 1536 dimensions per vector, do you have any tips on reducing the dimensions?

gilxng

Ggilxng Hi @joaobcosta, is there a way to reduce the dimensions size from [Resnet50](htt...

Isaac McFadyen

I

Isaac McFadyen•12/1/24, 4:55 PM

?pings

SuperHelpflare

S

SuperHelpflare•12/1/24, 4:55 PM

Please do not ping community members for non-moderation reasons. Doing so will not solve your issue faster and will make people less likely to want to help you.

Noah-Haf

NNoah-Haf What's the best way to diagnose the issue that's causing ``@hf/meta-llama/meta-l...

Raylight

R

Raylight•12/2/24, 2:15 PM

Been a while, but last time I checked the model had a limit of ~2800 tokens (input + output). Longer than that and you'd get a blank response. Most of the models give blank or truncated responses when reaching their limits, so that's the first thing I'd check.

blindChicken

B

blindChicken•12/2/24, 3:49 PM

Is there a way to get the number of tokens consumed by each request, both for input and output token?

Siddanth Reddy

S

Siddanth Reddy•12/3/24, 7:15 PM

Is there any zero-shot classification model available in Workers AI models, such as the one provided by Hugging Face (e.g., facebook/bart-large-mnli)?

anywhichway

A

anywhichway•12/4/24, 6:25 PM

Any chance Claude Haiku or Sonnet will come to workers ai?

anywhichway

Aanywhichway Any chance Claude Haiku or Sonnet will come to workers ai?

Isaac McFadyen

I

Isaac McFadyen•12/4/24, 7:11 PM

Workers AI models are hosted by Cloudflare (all are open-source models), they're not external providers like Claude or OpenAI, so no they won't be coming.

Isaac McFadyen

I

Isaac McFadyen•12/4/24, 7:12 PM

You can use AI Gateway to proxy requests to Anthropic's Claude, though.

anywhichway

A

anywhichway•12/4/24, 8:23 PM

Cluade licenses to Google, Amazon, and others. I was hoping Cloudflare would also strike a deal with them.

anywhichway

Aanywhichway Cluade licenses to Google, Amazon, and others. I was hoping Cloudflare would als...

Isaac McFadyen

I

Isaac McFadyen•12/4/24, 9:10 PM

While that might be possible, it would have to be a whole new product - Workers AI isn't designed for that. Plus, there's really not much point. The reason cloud providers license models like Claude is so that you can have unified billing if you already use that provider.

codebam

C

codebam•12/4/24, 10:53 PM

can someone help me with @cf/black-forest-labs/flux-1-schnell

codebam

C

codebam•12/4/24, 10:53 PM

when I save the file it doesn't open

codebam

C

codebam•12/4/24, 10:53 PM

I used

atob()

atob()

on it to convert the string to binary

codebam

C

codebam•12/4/24, 10:53 PM

am I supposed to do something else?

codebam

C

codebam•12/4/24, 10:54 PM

oh wait there's an example

codebam

C

codebam•12/4/24, 10:56 PM

the example doesn't work

codebam

Ccodebam can someone help me with @cf/black-forest-labs/flux-1-schnell

kyle

K

kyle•12/5/24, 1:45 AM

you have to convert from base64 to binary. in js I do

Buffer.from(base64Image, 'base64')

Buffer.from(base64Image, 'base64')

codebam

C

codebam•12/5/24, 1:46 AM

oh cool. that's a lot better than the thing cloudflare's example did

codebam

C

codebam•12/5/24, 1:46 AM

thanks

codebam

C

codebam•12/5/24, 1:48 AM

Buffer isn't in workers

codebam

Ccodebam Buffer isn't in workers

kyle

K

kyle•12/5/24, 1:49 AM

might have to do something here https://developers.cloudflare.com/workers/runtime-apis/nodejs/buffer/

Cloudflare Docs

Buffer · Cloudflare Workers docs

The Buffer API in Node.js is one of the most commonly used Node.js APIs for manipulating binary data. Every Buffer instance extends from the standard Uint8Array

class, but adds a range of unique capabilities such as built-in base64 and hex encoding/decoding, byte-order manipulation, and encoding-aware substring searching.

codebam

C

codebam•12/5/24, 1:50 AM

nah I'll just keep using

Uint8Array.from(binaryString, (m) => m.codePointAt(0));

Uint8Array.from(binaryString, (m) => m.codePointAt(0));

codebam

C

codebam•12/5/24, 1:50 AM

thanks tho

James

J

James•12/5/24, 1:53 AM

I asked this in the wrangler chat, but am I the only one who has to re-auth/re-allow wrangler to access workers AI locally every hour or two?

codebam

C

codebam•12/5/24, 1:54 AM

I don't have that issue

codebam

C

codebam•12/5/24, 1:54 AM

oh wait locally?

codebam

C

codebam•12/5/24, 1:54 AM

I didn't even know it worked locally. never used to

Isaac McFadyen

I

Isaac McFadyen•12/5/24, 2:00 AM

It now calls out to the remote Workers AI endpoint when developing locally, yeah.

James

J

James•12/5/24, 2:16 AM

Yeah it works, but it's irritating how I gave to re-auth it a few times a day

const inputs = {
          audio: [...new Uint8Array(arrayBuffer)],
          source_lang: 'tr',
          target_lang: 'tr'
        };
const transcriptionResponse = await env.AI.run('@cf/openai/whisper', inputs);

const inputs = {
          audio: [...new Uint8Array(arrayBuffer)],
          source_lang: 'tr',
          target_lang: 'tr'
        };
const transcriptionResponse = await env.AI.run('@cf/openai/whisper', inputs);