Does cloudflare worker ai support custom models? or just using the huggingface api?
Does cloudflare worker ai support custom models? or just using the huggingface api?
ICustom models are not currently supported. Only models that are added by the Cloudflare team (so not any HuggingFace model, just the ones that are on the list)
_all listed models enter on paid plan? i mean, if i pay all moedls listed will be discount of my usage?
_from my neurons?
_im starting with ia workers, ive created one worker with await env.AI.run("@hf/meta-llama/meta-llama-3-8b-instruct" on it, i want to know: when i call endpoint, usage is discounted from where? here?
JI think, using custom models will be a more competitive feature, and can summon the whole Ai industry to CF.
CF should look into this
CF should look into this
LCan the AI models used by Worker AI only be those provided by Cloudflare officially, or can users upload their own private AI models for use?
VFor now users can not upload custom models
Vabout a year ago, cloudflare introduced a project called Constellation, its APIs are much much lower level https://blog.cloudflare.com/introducing-constellation
The Cloudflare Blog
Today, we're excited to welcome Constellation to the Cloudflare stack. Constellation allows you to run fast, low-latency inference tasks on pre-trained machine learning models natively on Workers.
Vyou can upload any small ONNX models to constellation, and do inference things. but it's hardly to use, you have to translate all inference preprocess/postprocess to workers code
Vand it seems completely closed now 
LOh，got it！Thank you!
U@cf/qwen/qwen1.5-14b-chat-awq still isnt working with functions, is there any ETA on this?
JDALL-E is much better.
INot surprised, yeah. The newer models are decent.
IFLUX.1 in particular.
Ais DALL-E Available on cloudflare?
FNo for Workers AI at the moment, but you could use the OpenAI Endpoint in AI Gateway to make request to OpenAI: https://developers.cloudflare.com/ai-gateway/providers/openai/
Aok thanks
UAnything?
Isame with detr-resnet-50, I want to use custom weights
IWhile I am still at the drawing board stage therefore do not want to hit this form. Anyone know if this incurs extra or one-time charges and how expensive they are. I am looking for running yolov8 on workers AI.
Cis support for json mode planned
UI keep randomly getting the exception
Error in runWithTools: Error in runAndProcessToolCall: Unknown internal error
DHow do you find out your usage of workers AI models API? It always shows 0/10,000 neurons for me, although I have sent possibly hundreds of requests.
UYoure likely using a beta model
DYes, I am using multiple beta models. Are they not counted?
UNope
UFor as long as theyre in beta you have inf usage
DThat's really cool! Thanks for clarifying this for me.
SHello. Does anyone knows the neuron cost of the model
llama-3.1-8b-instruct-awq? I could not find this information. I am particularly interested in knowing whether that one is significantly cheaper than llama-3.1-8b-instruct-fp8. It seems that overall the neuron cost table is not up to date with the model list.SOh I see, sorry for the confusion!
SDo you know whether there will be a cost difference between the
awq and the fp8 once they are out of beta? Just to know whether it is worth trying to stick with the smaller weight one during development.
FHello, do you plan to add "deepseek-coder-v2" anytime soon? Thanks
A@kian i get this same type error with
edit: discord makes it hard to follow the context. the type error i am getting is:
(my code has an enum of models that can be used with retry logic in case one of the models doesn't give a good result)
4.20240909.0, the current most recent version of workers-types. however, i only started getting the error when i migrated from using the now deprecated @cloudflare/ai package to using await env.AI.run(…) directly, so it seems like the @cloudflare/ai types allow me to use one of the BaseAiTextGenerationModels, whereas the types for the direct AI binding (which use function overloading for usage with all possible types of AI generation) are, in my case, forcing the model argument to be type BaseAiImageToTextModels . i am using typescript v5.6.2.edit: discord makes it hard to follow the context. the type error i am getting is:
(my code has an enum of models that can be used with retry logic in case one of the models doesn't give a good result)
Hwhat are the ratelimits of workers ai beta models? can you help to understand these limits please?
Vhere is the document https://developers.cloudflare.com/workers-ai/platform/limits/
Cloudflare Docs
Workers AI is now Generally Available. We’ve updated our rate limits to reflect this.
Splans / date to support llama 3.2 3B ?
Sideal model for cloudflore (size)
AGitHub
Summary
new pricing page and changelog
dash refresh in separate PR
l3.2 in separate PR
Screenshots (optional)
Documentation checklist
[x ] The documentation style guide has been adhered to.
new pricing page and changelog
dash refresh in separate PR
l3.2 in separate PR
Screenshots (optional)
Documentation checklist
[x ] The documentation style guide has been adhered to.
Calready here https://playground.ai.cloudflare.com/
C
Access Google Forms with a personal Google account or Google Workspace account (for business use).
A
Kanyone know why the local example code takes 25 seconds to respond?
Koh it might be the model
Kno still slow 20 seconds minimum
Kthis is when i make a request to groq...
