`@cf/qwen/qwen1.5-14b-chat-awq` still isnt working with functions, is there any ETA on this?
@cf/qwen/qwen1.5-14b-chat-awq still isnt working with functions, is there any ETA on this?
JDALL-E is much better.
INot surprised, yeah. The newer models are decent.
IFLUX.1 in particular.
Ais DALL-E Available on cloudflare?
FNo for Workers AI at the moment, but you could use the OpenAI Endpoint in AI Gateway to make request to OpenAI: https://developers.cloudflare.com/ai-gateway/providers/openai/
Aok thanks
UAnything?
Isame with detr-resnet-50, I want to use custom weights
IWhile I am still at the drawing board stage therefore do not want to hit this form. Anyone know if this incurs extra or one-time charges and how expensive they are. I am looking for running yolov8 on workers AI.
Cis support for json mode planned
UI keep randomly getting the exception
Error in runWithTools: Error in runAndProcessToolCall: Unknown internal error
DHow do you find out your usage of workers AI models API? It always shows 0/10,000 neurons for me, although I have sent possibly hundreds of requests.
UYoure likely using a beta model
DYes, I am using multiple beta models. Are they not counted?
UNope
UFor as long as theyre in beta you have inf usage
DThat's really cool! Thanks for clarifying this for me.
SHello. Does anyone knows the neuron cost of the model
llama-3.1-8b-instruct-awq? I could not find this information. I am particularly interested in knowing whether that one is significantly cheaper than llama-3.1-8b-instruct-fp8. It seems that overall the neuron cost table is not up to date with the model list.SOh I see, sorry for the confusion!
SDo you know whether there will be a cost difference between the
awq and the fp8 once they are out of beta? Just to know whether it is worth trying to stick with the smaller weight one during development.
FHello, do you plan to add "deepseek-coder-v2" anytime soon? Thanks
A@kian i get this same type error with
edit: discord makes it hard to follow the context. the type error i am getting is:
(my code has an enum of models that can be used with retry logic in case one of the models doesn't give a good result)
4.20240909.0, the current most recent version of workers-types. however, i only started getting the error when i migrated from using the now deprecated @cloudflare/ai package to using await env.AI.run(…) directly, so it seems like the @cloudflare/ai types allow me to use one of the BaseAiTextGenerationModels, whereas the types for the direct AI binding (which use function overloading for usage with all possible types of AI generation) are, in my case, forcing the model argument to be type BaseAiImageToTextModels . i am using typescript v5.6.2.edit: discord makes it hard to follow the context. the type error i am getting is:
(my code has an enum of models that can be used with retry logic in case one of the models doesn't give a good result)
Hwhat are the ratelimits of workers ai beta models? can you help to understand these limits please?
Vhere is the document https://developers.cloudflare.com/workers-ai/platform/limits/
Cloudflare Docs
Workers AI is now Generally Available. We’ve updated our rate limits to reflect this.
Splans / date to support llama 3.2 3B ?
Sideal model for cloudflore (size)
AGitHub
Summary
new pricing page and changelog
dash refresh in separate PR
l3.2 in separate PR
Screenshots (optional)
Documentation checklist
[x ] The documentation style guide has been adhered to.
new pricing page and changelog
dash refresh in separate PR
l3.2 in separate PR
Screenshots (optional)
Documentation checklist
[x ] The documentation style guide has been adhered to.
Calready here https://playground.ai.cloudflare.com/
C
Access Google Forms with a personal Google account or Google Workspace account (for business use).
A
Kanyone know why the local example code takes 25 seconds to respond?
Koh it might be the model
Kno still slow 20 seconds minimum
Kthis is when i make a request to groq...
BGroq doesn’t use gpus so it’s obviously way faster but 25 seconds is indeed quite long
Kwell which other api isnt really the issue - cloudflare ai is :D
Kjust saying, a remote api request takes 500ms vs cloudflare ai, no matter which model, takes 20+ seconds
Kand im not sure if that is me or if that is normal
BIs it me or did the LLM pricing increase with the newer pricing model? Some models were $0.11 like mixtral, now $0.15 with that new bracket. Anyways, I don't think I'm using Workers AI anytime soon—But I did like a lot of the other updates like no longer being billed for service binding invocations (as it always should've been), so now I'm encouraged to use them rather than package/link every microservice as a library in a single build to avoid the previous anti-microarchitecture model lol.
BI've looked up
llama-3.1-8b-instruct, and they seem all beta models. Maybe that's why? Try another model
Kalrady said that, doesnt matter which model
K(theyre basically all beta)
KK
K
Kvs groq (or whichever) api call
