RNo. You would have to modify runWithTools to be able to do that, e.g. https://github.com/cloudflare/ai-utils/compare/main...Raylight-PWL:ai-utils:Raylight-patch-maxTokens-option.
U:frown:
UI think a good idea would be to have either max_tokens be the max tokens for each call, or have the user able to configure the max tokens for each call
Uthe second option being something like initial_max_tokens, tool_max_tokens, and possibly trim_max_tokens (very scuffed index names, but you get the point)
UIts been really good
UUon normal CF ai i had to guess so much 
Uai-utils is definitely awesome in comparison
UxD
Ui once tried to read the actual AI library on npm to figure out unknowns
UNever trying that again!
Ucompiled code :salute:
Unp!! :D
UI have a quick question
Uconsidering you do ai-utils shenanigans
Uare there any plans on tool usage being supported on the qwen models?
Ufrom what I read, the actual model itself supports it, but I'm obviously not entirely sure on it
UIt's not documented as so, and when I tried I could not get it to work haha
Uthen again I could also have been doing it wrong.
UNo, it just never actually ran the tool code
Ubut I also couldn't get it to work on the documented model so I was probably doing it wrong
Uone secaroo
Uif i can find the project within the mess of my projects folder...
UUIt's supposed to run the tool when the user sends "Follow me" or "Come here" etc etc
Unot sure what I did wrong :P
U(my code would parse the string after-the-fact)
UAIModel is defined as
@cf/qwen/qwen1.5-14b-chat-awq, ai is env.aiUI can dm you my worker ID if needed
Uah alright
UThankyuu! :D
JIs the
@cf/llava-hf/llava-1.5-7b-hf model not working right now? Seems to be throwing 4002: could not route request to AI model
JHey , I need some information related to calculating acutal cost of beta models. I am planning to integrate
So I want to know how can I calculate the pricing of the image generation models they all are in beta currently
Thanks.
@cf/bytedance/stable-diffusion-xl-lightning in my app. My app has daily 50k+ active user, but the app is not yet Ai related I am thinking to add some Ai features in it so it can also be used as an Ai app in future. So I want to know how can I calculate the pricing of the image generation models they all are in beta currently
Thanks.
RSeems like seed, temperature etc doesn't have any effect when using
@hf/nousresearch/hermes-2-pro-mistral-7b. Is this a known issue/feature? (Looks like the model produces deterministic results. To be able to get some randomness in the output would make testing easier when doing function calling.)JThe TypeScript story with Workers AI really needs a lot of improvements. It'd be good to see this fixed soon for a product that advertises GA. https://github.com/cloudflare/workerd/issues/2418