╰─± wrangler -v ⛅️ wrangler 3.99.0 ------------------- i didn't change anything in the code, and i

╰─± wrangler -v

wrangler 3.99.0
-------------------

i didn't change anything in the code, and it was working fine a few hours ago

James•1/2/25, 10:50 PM

Can you share what your AI binding looks like in your

wrangler.toml

wrangler.toml

James•1/2/25, 10:51 PM

nevermind, I can reproduce

James•1/2/25, 10:52 PM

going to escalate

usfOP•1/2/25, 10:53 PM

Thanks James!

Uusf ╰─± wrangler -v ⛅️ wrangler 3.99.0 ------------------- i didn't change anythin...

snoob•1/2/25, 11:01 PM

just wanted to tag on that im also experiencing this @James and thankful im not the only one haha

James•1/2/25, 11:11 PM

The team are aware and actively looking into this, thanks folks

usfOP•1/2/25, 11:45 PM

Yes it does tysm!

Victor•1/3/25, 2:21 AM

Workers AI's OpenAI compatible endpoint is missing the indexindex property during text chat completion (streaming) https://platform.openai.com/docs/api-reference/chat/streaming
(screenshot is returned)

sashizosh•1/3/25, 11:23 PM

Hey guys, I am trying to use this text generation model but I am getting a typescript error:
const response = await context.env.AI.run("@cf/meta/llama-3.3-70b-instruct-fp8-fast", { messages });

No overload matches this call.
The last overload gave the following error.
Argument of type '"@cf/meta/llama-3.3-70b-instruct-fp8-fast"' is not assignable to parameter of type 'BaseAiImageToTextModels'.ts(2769)
index.d.ts(3720, 3): The last overload is declared here.

Has anyone been through this before? I was able to find an open issue on github but the PR is still open so I assume they haven't pushed a fix for it

James•1/4/25, 12:01 AM

That should be fixed with the most recent workers-types version, via https://github.com/cloudflare/workerd/pull/3242. Are you up to date?

JJames That should be fixed with the most recent workers-types version, via <https://gi...

bat ✞•1/5/25, 11:39 PM

Hey, the docs are sorta confusing, Are we able to pay for more neurons?
If so, is it monthly, could you provide some help about the neurons?

bat ✞•1/5/25, 11:40 PM

Since the docs say we have 100k requests, but ai says we have 10k neurons

James•1/6/25, 12:00 AM

Workers AI pricing is all kinds of confusing right now. Docs talk about tokens which is the “new” method that was set to go into action on November 1st but never happened, dashboard talks about neurons, old marketing talks about neurons, etc.

Bbat ✞Hey, the docs are sorta confusing, Are we able to pay for more neurons? If so, i...

James•1/6/25, 12:01 AM

Hopefully we can get some more official clarification and updates soon

JJames Workers AI pricing is all kinds of confusing right now. Docs talk about tokens w...

bat ✞•1/6/25, 12:01 AM

How are we able to get more neurons?

James•1/6/25, 12:01 AM

Neurons aren’t a thing anymore - it’s token based now, but nothing in the UI reflects that

James•1/6/25, 12:02 AM

It’s usage based though - you just pay for how many you use

JJames Neurons aren’t a thing anymore - it’s token based now, but nothing in the UI ref...

bat ✞•1/6/25, 12:02 AM

But what about the "5k/10k daily neurons used"?

JJames Workers AI pricing is all kinds of confusing right now. Docs talk about tokens w...

James•1/6/25, 12:02 AM

That’s outdated, hence the confusion

James•1/6/25, 12:02 AM

Upgrade to workers paid and then it’s usage based

JJames That’s outdated, hence the confusion

bat ✞•1/6/25, 12:02 AM

Yeah I'm pretty confused

JJames Upgrade to workers paid and then it’s usage based

bat ✞•1/6/25, 12:02 AM

Ah, by the way by every token is it per character or per word?

bat ✞•1/6/25, 12:02 AM

Like what do you guys define a token as

James•1/6/25, 12:03 AM

I couldn’t tell you, frankly. Docs are confusing and there’s no usage reports in the dash for tokens to clarify

JJames I couldn’t tell you, frankly. Docs are confusing and there’s no usage reports in...

bat ✞•1/6/25, 12:03 AM

0.000015$ per token, does that mean per word?

James•1/6/25, 12:03 AM

Hopefully we’ll get some clarification soon - this was meant to happen November 1st but didn’t

James•1/6/25, 12:03 AM

I don’t know

bat ✞•1/6/25, 12:03 AM

Oh alright

bat ✞•1/6/25, 12:03 AM

I just need to know before we start paying

James•1/6/25, 12:04 AM

Sorry I can’t be of more help. We’re (the community) all just as confused as you

bat ✞•1/6/25, 12:04 AM

As we don't wanna go around spending too much, though 1 token per word seems more reasonable

JJames Sorry I can’t be of more help. We’re (the community) all just as confused as you

bat ✞•1/6/25, 12:04 AM

Yeah it's alright thank you alot

Bbat ✞0.000015$ per token, does that mean per word?

Chaika•1/6/25, 12:31 AM

This is a more generic AI/LLM question, tokens are their sort of base building blocks, not always matching up with a single word: https://www.johno.com/tokens-vs-words

CChaika This is a more generic AI/LLM question, tokens are their sort of base building b...

bat ✞•1/6/25, 12:33 AM

Thank you!
But for example, if I used only latin and symbols, how much would a token be?

Chaika•1/6/25, 12:33 AM

Depends on the model you use/it's tokenizer

Chaika•1/6/25, 12:35 AM

For example, OpenAI's tokenizers are like this: https://platform.openai.com/tokenizer, cool visulization to play around with

Chaika•1/6/25, 12:36 AM

one for a model that is on Worker's AI, Lllama 3's https://lunary.ai/llama3-tokenizer
Mistral and Gemma's linked on that one too

CChaika one for a model that is on Worker's AI, Lllama 3's https://lunary.ai/llama3-toke...

bat ✞•1/6/25, 12:55 AM

What about mixtral's?

Bbat ✞What about mixtral's?

Isaac McFadyen•1/6/25, 1:29 AM

Mixtral uses the Mistral tokenizer.

Isaac McFadyen•1/6/25, 1:30 AM

So it'll be the same as the Mistral button on that page.

IIsaac McFadyen Mixtral uses the Mistral tokenizer.

bat ✞•1/6/25, 1:31 AM

Oh alright thanks

kyle•1/7/25, 6:26 PM

I noticed that llama 3.1-8B is out of beta as of the past month or so, but I don't see any reference to this in the Workers AI changelog. imo a billing-impacting change like this needs to be mentioned in the changelog

Cloudflare Docs

Changelog · Cloudflare Workers AI docs

Review recent changes to Cloudflare Workers AI.

blindChicken•1/7/25, 9:03 PM

I don't see any reranking models in the models offered by CF. Is there any plan to add one or more in the near future? BAAI embedding models are offered, it would be great to also offer their reranking model: https://huggingface.co/BAAI/bge-reranker-base.

CChaika hmm guessing it's still cooking? It throws ` "message": "5006: must be st...

zabatonni•1/8/25, 6:27 PM

not working for me, what it should be? I tried uint8, base64 but nothing seems to work

LordQ•1/9/25, 10:21 AM

Hi, do you know how to get more than only 5 labels and scores as the result?

Destiny•1/10/25, 9:31 AM

does setting width and height to 2048 result in a 500 error?

Destiny•1/10/25, 9:31 AM

i am on a free plan

Destiny•1/10/25, 9:37 AM

also when i set the width to 1600 and height to 900. i seem to get this error

AiError: AiError: Invalid or incomplete input for the model: model returned: Invalid input

AiError: AiError: Invalid or incomplete input for the model: model returned: Invalid input

ella•1/10/25, 1:33 PM

i have cf enterprise. is there anyway to upload my own mode lto workers ai?

ella•1/10/25, 1:44 PM

bruh

╰─± wrangler -v ⛅️ wrangler 3.99.0 ------------------- i didn't change anything in the code, and i

Similar Threads

Similar Threads

Similar Threads