BWhy a cpu? Cf has gpus in their machines
BHuh
BWhy thumbs up
Ddoes flux work for anyone?
i'm getting
i'm getting
AiExternal: Couldn't fetch external AI provider response (500, Internal Server Error)Dusing the code provided in the docs here: https://developers.cloudflare.com/workers-ai/models/flux-1-schnell
RIt takes a long time because you're not using streaming. You're basically waiting for the LLM to generate the whole text before returning a response.
Kit takes 20 seconds to write a sentence?
Khow’s any other external api then 30x faster?
Kthat still doesn’t make any sense
RTry the playground (https://playground.ai.cloudflare.com/) with your prompt and you'll get a feel for the perfomance.
Kyeah takes a second
Kpick meta llama
prompt: What is the origin of the phrase Hello, World
prompt: What is the origin of the phrase Hello, World
Kalright you might be right
Kit’s just super ass slow lol
Kbut streaming it won’t make the response faster, just streamed
FI'm using Llama via api.cloudflare with Bearer Auth. Where can I check my usage? If I exceed 10,000 free neurons, am I charged automatically or does it stop working?
BIt stops working
BAnd their pricing is no longer in neurons
BCloudflare Docs
Workers AI is included in both the Free and Paid Workers plans and is priced based on model task, model size, and units.
Rneurons may have been the worst idea ever conceptualized
Kbetter :)
Koh btw. in the worker binding
Kasync env.AI.run()
Kis there docs on this, i cant find them...
Kim curious if theres a seed param like openai offers in the latest models
Kto get more deterministic results
Kalmost looks like sending a seed param worked somehow
RCheck the model page(s) (https://developers.cloudflare.com/workers-ai/models/llama-3.1-8b-instruct-fast#Parameters). Beware that for the most part, models within a category list the same set of parameters. E.g. @hf/nousresearch/hermes-2-pro-mistral-7b doesn't support temperature or seed, even though those parameters are listed on the model page. (Reported it here workers-ai a while ago. Never got any response so no idea if it's intended to be that way). Also, expect some quirks. E.g. a subset of the models will break if you set max_tokens to 597 or higher (Reported here workers-ai)
Iwhat formats are support in cf/whisper?
Koh so each model has its own parameter, thanks
Tit seems like seed in all stable diffusion models does not work at all. I'm trying to use the same seed and it all produced different output. Am I doing anything wrong?
EI'm trying to get started with workers ai function calling, for the life of me I can't get it it to call the function I've provided or get it to return in the schema shape that I've specified. I always need the response to be in the json schema that I've given. With open AI you could enforce this with tool_choice. is there an equivalent for workers ai / hermes 2?
CIsit the playground or something else that allows you to use aCF gui to build multiple interactions and outputs pipelines
Iplease tell me the files supported in cf/whisper, no files work for me
Thave you tried wav format?
LDoes anyone know how I can check if a model exists in the cloudflare API?
LUsing the rest api
TPotentially dumb question (haven't used Workers AI much before) is it possible to parse (into a normalised object) and/or summarise pdfs and doc files? ChatGPT allows you to upload arbitary files and parse/summarise them. I know it's possible for images?
CThis would be nice, structured outputs/json mode
Bthere is an example "chat with PDF" app that could help? https://x.com/rafalwilinski/status/1830911922805551560
Can you build a full-stack AI app on @cloudflare? The answer is: absolutely.
Introducing "Fullstack Cloudflare RAG" aka Chat with PDFs solution built 100% on Cloudflare using only their services.
Link to demo
Introducing "Fullstack Cloudflare RAG" aka Chat with PDFs solution built 100% on Cloudflare using only their services.Link to demo
9/3/24, 10:13 AM
Kare the beta models still free and unlimited?
Kor does it count towards the free limit now
TCloudflare Docs
Workers AI is included in both the Free and Paid Workers plans and is priced based on model task, model size, and units.
Kyeah I checked that, it doesn't mention about beta models so I came here to confirm
TStandard models are large image models such as @cf/stabilityai/stable-diffusion-xl-base-1.0...It lists this model in the pricing, which is beta.
CHi everyone! I need some help with integrating Cloudflare with mailchimp. Specifically, I’m looking for guidance on how to copy and paste the CNAME and A Record codes from mailchimp into Cloudflare in the right places without messsing up my company's connections, Where exactly should I put them? Any tips or steps would be greatly appreciated
