i dont see where the "prompt" property would come in as I don't see that documented anywhere, but ev
i dont see where the "prompt" property would come in as I don't see that documented anywhere, but everything else is properties of a tool
KHi all, anyway to speed up workers ai through rest api? responses are taking up to 30s, while I have a local llama3.1 running on a rtx3080 and it only takes like 6s?
OWhat's the pricing for neurons on text to image generation?
RThese error messages can be quite cryptic. Omitting the property "type" inside a single parameter of a single tool would produce the same error, for example. In your example with
parameters: {}parameters: { type: "object", properties: {} }
UInteresting.
UThat is very cryptic indeed
UI feel like this is definitely an issue with upstream
AI see that four of the text generation models support LoRA adapters. Is LoRA support for text-to-image models currently in the works?
Hhey this side mrinal I have a prior project on cloudflare using workers-ai, but when started with another project using ai it showed me the there is likely additional logging output above
Hany soution for that ?
RAnyone know of a full (working) example project with supporting files for an AI worker utilizing OpenAI tool usage? Not just a snippet that assumes everything else is gtg. So far my project is pretty capable of generating frustration and 500 errors.
KAll our text-to-image models are currently in beta, which means they are free to use until they graduate from beta
https://developers.cloudflare.com/workers-ai/models/#text-to-image
https://developers.cloudflare.com/workers-ai/models/#text-to-image
Kis there a specific model you are interested in using LoRAs with?
CHi, I have written a Vue 3 app which uses Vite to talk to the Llama AI worker. This works fine when running locally via the vite dev server as I am using a proxy however, after deploying to Cloudflare Pages, my requests are no longer proxied via the Vite dev server so the requests are going to the Llama AI but the OPTIONS request comes back with a 400 error. Any ideas how I can get this working correctly? Appologies if this needs posing in the Pages section of Discord - it's cross product so felt this was a better place as the issue is with talking from CF Pages to the CF AI
BIs there a way to specify stop tokens? This is very important to me cause I mainly will be using the
rawWere you able to get the functions to actually execute with the model?
Ubecause I'm still unable to do so lol
RWith qwen? no. I don't think qwen is supported. I would like to see Cloudflare add support for "stop words" so that I can implement it myself.
WHey all, any chance CF is working on a Background Removal from image integration? e.g. @imgly/background-removal-node.
I'd love to use it in a worker, but since it's downloading models on the fly (edit: oh for prod you can serve the models statically, but still not possible/ a good thing to do in a Worker I think) I need to implement it in my NodeJS API.
So was just wondering if there was anything in the pipeline for it. Keep rocking.
I'd love to use it in a worker, but since it's downloading models on the fly (edit: oh for prod you can serve the models statically, but still not possible/ a good thing to do in a Worker I think) I need to implement it in my NodeJS API.
So was just wondering if there was anything in the pipeline for it. Keep rocking.
AHello. Was this issue with
InferenceUpstreamError: undefined: undefined@cf/microsoft/resnet-50Gist
Code + error on CF workers AI. GitHub Gist: instantly share code, notes, and snippets.
IWorkers AI/Cloudflare won't have any control of this, if it did happen (not sure if it will) it would be due to the underlying model which is
Intel/distilbert-base-uncased-finetuned-sst-2-english-int8-static-inc
AHey, I wonder how I can be notified when specific AI models on AI workers will be out of beta?
ACan anyone help with this
AI have a really basic AI request:
The function gets called (I can put a debugger break in dev tools ). The AI run never seems to return and I ultimately get the error below. I have authorized wrangler to access my account and confirmed the AI is bound in wrangler.toml:
The function gets called (I can put a debugger break in dev tools ). The AI run never seems to return and I ultimately get the error below. I have authorized wrangler to access my account and confirmed the AI is bound in wrangler.toml:
MHey guys, what is up?
I'm curious, is there a way to request to add a model to the list? I'm just looking for opportunities for my models to be added to public lists/tools such as workers AI.
I'm curious, is there a way to request to add a model to the list? I'm just looking for opportunities for my models to be added to public lists/tools such as workers AI.
TA good Image Embedding model someday...? Would fit so nicely with Vectorize wouldn't it?
RI can't reproduce "undefined: undefined" but haven't tried running locally. That said, make sure that the image is smaller than 2.5-3 MB. (
JSON.stringify(inputs).length
JWhen I make a query in a non-English language, the response comes out broken. Has anyone else experienced this? This doesn't happen when I use llama3.1 with ollama. Please improve support for non-English queries. Especially for Llama 3.1.
Athat was happening locally. ill check the image size and get back to you
SHeyhey!
I was wondering if/when the documentation for this endpoint will be updated:
https://developers.cloudflare.com/api/operations/workers-ai-post-run-model
The responses are not correct.
Successful responses return more than result, they also return a success, errors and messages code where I can only assume that the errors and messages content is strings (thou it might very well be status codes of some sort) and the result contains a model-specific response.
For example for the M2M100-1.2B translation model it is translated_text (which is somewhat documented in the api schema definition of the worker: https://developers.cloudflare.com/workers-ai/models/m2m100-1.2b/)
For unsuccessful responses thou, the result is really weird. On wrong input I got this for example:
{
"result": {
"translated_text": "ERROR: invalid source_lang (English)"
},
"success": true,
"errors": [],
"messages": []
}
which is, very confusing and odd to use. It says success, even thou there's an error. The errors section is empty. The messages section is empty and the message itsself is in the model result. :/
It is also unclear which input values for this model are allowed.
I found this (https://github.com/cloudflare/cloudflare-docs/blob/production/content/workers-ai/models/m2m100-1.2b.md), but it doesnt seem to list all languages.
I also found this (https://github.com/ikergarcia1996/Easy-Translate/blob/main/supported_languages.md#supported-languages-m2m100), but the cloudflare version only seems to work with flatcase conventions and the "ld" abbreviations. It's also unclear if these abbreviations follow ISO 639, some other standard or if they are arbitrary.
I was wondering if/when the documentation for this endpoint will be updated:
https://developers.cloudflare.com/api/operations/workers-ai-post-run-model
The responses are not correct.
Successful responses return more than result, they also return a success, errors and messages code where I can only assume that the errors and messages content is strings (thou it might very well be status codes of some sort) and the result contains a model-specific response.
For example for the M2M100-1.2B translation model it is translated_text (which is somewhat documented in the api schema definition of the worker: https://developers.cloudflare.com/workers-ai/models/m2m100-1.2b/)
For unsuccessful responses thou, the result is really weird. On wrong input I got this for example:
{
"result": {
"translated_text": "ERROR: invalid source_lang (English)"
},
"success": true,
"errors": [],
"messages": []
}
which is, very confusing and odd to use. It says success, even thou there's an error. The errors section is empty. The messages section is empty and the message itsself is in the model result. :/
It is also unclear which input values for this model are allowed.
I found this (https://github.com/cloudflare/cloudflare-docs/blob/production/content/workers-ai/models/m2m100-1.2b.md), but it doesnt seem to list all languages.
I also found this (https://github.com/ikergarcia1996/Easy-Translate/blob/main/supported_languages.md#supported-languages-m2m100), but the cloudflare version only seems to work with flatcase conventions and the "ld" abbreviations. It's also unclear if these abbreviations follow ISO 639, some other standard or if they are arbitrary.
Interact with Cloudflare's products and services via the Cloudflare API
GitHub
Easy-Translate is a script for translating large text files with a SINGLE COMMAND. Easy-Translate is designed to be as easy as possible for beginners and as seamlesscustomizable and as possible fo...
TDoes anyone know the pricing for whisper-tiny-en?
Dis there any support for dialects in the translation AI model? Standard locale codes don't seem to be valid. Things like Brazilian Portuguese or the Hong Kong or Tawainese variants of Chinese.
SThere's a list of supported languages in here somewhere
DOh I hadn't seen your comment previously. Yeah I couldn't find a list. It does seem like, contrary to most of the docs, that it only takes lowercase two char codes. Not wanting to look a gift horse in the mouth, but have the ability to translate Portugal Portugese and Brazil Portugese separately would be very nice (along with the variants of zh, etc... )
SFull names work for me. 
Slowercase
Dah, I've been using the two letter codes successfully. but no "pt_BR" or "zh_TW" etc... 
Kzh-twpt-brDoesn't work for the Translation AI: "ERROR: invalid target_lang (zh-tw)"
KOops, I thought I was in the Turnstile channel.
KIn that case, all of the languages supported by the model should be on https://huggingface.co/facebook/m2m100_1.2B#languages-covered which indeed doesn't cover dialects.
Dah, thank you very much!