UYou use the assistant to teach it how to respond
Toh, wait I see
Tyour example actually includes user prompts as part of the general mechanism describing it how ot behave
TLet me try that, thank you!
TI didn't think I can or should use user prompts to explain LLM something, I was 100% sure user prompts are jsut the user input and I shouldn't mess with that 
TWouldn't that mess with user's history a bit?
TIf I use any term llm will probably remember thatn and just assume that user either already knows about it or is still referring to it
TWell, I tried, it got a lot more stable which is a huge improvement so far, although it still deviates a lot from what I get on meta.ai on the same model for some reason. On meta.ai i literally get perfect results. I am not sure what may be different there
CHi @Aurelios this might be just what you are looking for! https://github.com/craigsdennis/vanilla-chat-workers-ai/
GitHub
Contribute to craigsdennis/vanilla-chat-workers-ai development by creating an account on GitHub.
Vyoo, I'm gonna steal your json model list generation, but instead of beta/ga, I'll make it replace
modelMappings@cloudflare/ai@cloudflare/workers-types
Mhello how to make cross x forwarded for ip in workers
CSteal away! And yeah modelMappings should be considered on it's way to deprecation
AHello, could you please ask if it is possible to integrate the Qwen2 series models into the Cloudflare AI platform? Thank you.
TWas glad to see that cloudflare has whisper, but the particular model is not mentioned anywhere. I searched this channel and now i can see that it is the base model. OpenAI is $0.006 vs $0.0022 BUT it is running the large v3 model. If cloudflare adds more model options it would be attractive
Fcan I use beta llm model in prod? I need the latest model (llama 3-8b) but its not out of beta yet. Do you know the rate limit on free beta models?
VFrom a technical perspective, there's nothing stopping you. However beta comes without SLA guarantees and is simply "best effort". Usage is also free for the duration while in beta, but will be charged after. Also
Beta models may have lower rate limits while we work on performance and scalehttps://developers.cloudflare.com/workers-ai/platform/limits/
Cloudflare Docs
Workers AI is now Generally Available. We’ve updated our rate limits to reflect this.
MWhen qwen2 :O?
FDoes this mean Paid Workers ($5) give 300000 neurons for free, or is this the upper limit?
Uits included usage, no upper limits beyond standard rate limits
IConsidering it was literally released yesterday, it might be a bit still 
Fwhat does included mean? do you mean the $5 includes 300000 neurons?
Rit's confusing
UWhat is? The included usage? Not sure how else they could word it to say that you get usage included 
Fare you sure its free 300000?
Foh I see 10k a day, 30 days a month?
Fuh oh that means we get less than 10k a day for months with more than 30 days? xD
IYou get 10k a day.
ISo in a month with 31 days, you get 310 000
Jare there plans to add any multimodal models like clip?
I’d like to be able to store images and query them with text.
Using replicate rn, but would love to keep everything on cloudflare
I’d like to be able to store images and query them with text.
Using replicate rn, but would love to keep everything on cloudflare
FCloudflare Docs
Run AI models in Workers, Pages, or via API.
Fllava 1.5 only support tiny tiny images (336x336) though
Fat least its cheap lol
FI hope they add 1.6 which supports much bigger images
Jyeah thats a bit too small unfortunately
Fto be fair CLIP models also only process tiny images 224X224 or 336x336
AHello everyone, I have a question regarding worker AI token management. I created a token through the REST API page, but I can’t seem to find where the tokens I’ve created are displayed. Can anyone help?
GI'm entering this command but somehow it's not working:
showing this error:
#cloudflare-typescript #wrangler #vectorize-beta
showing this error:
#cloudflare-typescript #wrangler #vectorize-beta
Ffyi tagging the channels doesn't do anything, you should post your question in the respective channels
Falso according to this u need to be on a paid plan to use vectorize https://github.com/cloudflare/workers-sdk/issues/4042
GitHub
Which Cloudflare product(s) does this pertain to? Wrangler core What version(s) of the tool(s) are you using? 3.10.0 [Wrangler] What version of Node are you using? 18.14.0 What operating system are...
LHello, I am trying to upload
adapter_model.safetensors
Ksearch bar: search "token" and "API Tokens" will come up
Kor can go to "My Profile" and click on "API Tokens"
FHello, do you plan to add Stable Diffusion 3 Medium to Model Catalog?
LAny plans to add newer OS embedding models?
LI'm building a speedy search where my API is in the worker and using bge small seems much nicer. But it has falled behind in constrast to the latest & greatest...
IGiven that Stability AI has an extremely restrictive commercial license, and that the model actually isn't that good compared to SDXL (especially the fine-tuned SDXL models) I highly doubt it.
IAre there plans to add constrained generation (specifically json output) to the LLMs and LORA hosting of models on Workers?
I know there was some conversation about this back in March, but haven't seen any updates since: workers-ai
I know there was some conversation about this back in March, but haven't seen any updates since: workers-ai