Is flux-1-schnell cheaper on cloudflare in comparision to fal?
Is flux-1-schnell cheaper on cloudflare in comparision to fal?
AYes. Much cheaper
DHey guys, I'm trying to upload images to Workers AI REST API with Python, but I'm getting error messages. Any tips?
![[FDG] H4kuna](https://cdn.discordapp.com/avatars/255091346673500160/6c2c2f7815558a8212313999b10fbd78.webp?size=40)
[Hi, guys, I have a problem and I have a lot of doubts about how I can solve it, and I'm thinking about using supervised learning. Here's the problem: I have a price comparison tool and I need to be validating, buying, identifying products that are identical but with different characteristics, for example, GOD OF WAR = GOD OF WAR 2018 = GOD OF WAR ™, this is one of the examples I've been facing. Can you give me an idea of a tool or something that can help me with this, I'm studying it but I'm extremely lost on how I can do this.
AHi, I'm having an issue where CF AI has completely stopped working from my local environment (yesterday it was working fine). Not getting any errors or anything, just the AI is obviously not running and not returning anything. Has anything changed with how Cloudflare handles this?
ATo add to this, it is explicility llama-3-8b-instruct. Changing it to a different model (3.1-8b) fixed it. This seems to only happen from my local environment -- production calls to 3-8b seem to still be working fine.
RAny chance of higher free allocations (i.e. tokens/steps/units per day) on the Workers Paid plan? Like.. something that's more in line with the spirit of the rest of the Workers platform where the limits are (more than) generous enough to build a simple prototype or follow a tutorial.
Looking at the table (https://developers.cloudflare.com/workers-ai/platform/pricing/#free-allocation), taking image generation as example, you'd easily hit 250 steps just to fix a simple bug or help someone out.
Looking at the table (https://developers.cloudflare.com/workers-ai/platform/pricing/#free-allocation), taking image generation as example, you'd easily hit 250 steps just to fix a simple bug or help someone out.
![[FDG] H4kuna](https://cdn.discordapp.com/avatars/255091346673500160/6c2c2f7815558a8212313999b10fbd78.webp?size=16)
Kidentify the main title, offer alternative options to drill down to the user, probably best solution
Kits like "apple iphone" :D
Aany idea when the dashboard will be updated to show the new unit of billing?
Also is there any way to get that now?
Also is there any way to get that now?
Sguys - are beta models still free? (i remember they used to be)
I couldn't find that in documentation anymore
I couldn't find that in documentation anymore
0Hey guys, I would like to ask whether the LLM in cf worker AI is full precision or quantized, such as LLaMA3.1:70b
F?crossposting
FPlease do not post your question in multiple channels/post it multiple times per the rules at #
welcome-and-rules. It creates confusion for people trying to help you and doesn't get your issue or question solved any faster.
welcome-and-rules. It creates confusion for people trying to help you and doesn't get your issue or question solved any faster.
Eyes
0sry
0:MeowHeartCloudflare:
CAny updates on the use any model beta
�i believe @cf/meta/llama-3.1-8b-instruct-fast in problem, in several days, it usually returns empty answer
Phey guys i am to use llama 3.2 but it is getting an error in workers, how can i use it
Bis there a way to check the context length of models hosted on cf?
EHello, I'm trying to set up Worker AI. I got this {"response":"Content-Type invalid"}
Any thoughts?
Any thoughts?
FCheck if your AI request works with
curl and when it does implement it inside the worker. Example request that works for me ->EOK. I got it working
EWhere do I add stream: true, max_tokens: 2048,
FOn the same level as
messages, in doubt ask any chatbot website to format this correctly for you.
IHi I am using https://developers.cloudflare.com/workers-ai/models/llama-2-7b-chat-int8/
can anyone please suggest me how can I calculate Input and Output token for price calculation
can anyone please suggest me how can I calculate Input and Output token for price calculation
Cloudflare Docs
Quantized (int8) generative text model with 7 billion parameters from Meta
FCloudflare Docs
Workers AI is included in both the Free and Paid Workers plans and is priced based on model task, model size, and units.
IPlease suggest me programeticaly how can calculate the price when any API call perform
FThat would require tokenization which is different for every LLM. If you only need one model it might work, but if you plan to switch between models and even providers, you might need to reach out for something like -> https://www.helicone.ai/
IHi right now I am working on https://developers.cloudflare.com/workers-ai/models/llama-2-7b-chat-int8/
This is from cloudflare, so I want to calculation of token for this CF model
This is from cloudflare, so I want to calculation of token for this CF model
Cloudflare Docs
Quantized (int8) generative text model with 7 billion parameters from Meta
FWell, google for a LLama 2 tokenizer then, e.g. -> https://github.com/belladoreai/llama-tokenizer-js (or use the official Python Sentencepiece tokenizer like this -> https://github.com/meta-llama/llama/blob/main/llama/tokenizer.py)
GitHub
JS tokenizer for LLaMA 1 and 2. Contribute to belladoreai/llama-tokenizer-js development by creating an account on GitHub.
IIs Cloudflare not providing anything related to this?
FNope. Cloudflare AI does not even return the token amount in the response or anywhere else as far as I can see.
�flux is weird, usually happens
KGood morning, periodically when I run batches of updates to content using vectorize,I receive an error AiError: 3001: Unknown interal error. How can I get more insights on what's going on?
Could this be too many requests on the AI requests?
For embedding
Could this be too many requests on the AI requests?
For embedding
F?crossposting
FPlease do not post your question in multiple channels/post it multiple times per the rules at #welcome-and-rules. It creates confusion for people trying to help you and doesn't get your issue or question solved any faster.
welcome-and-rules. It creates confusion for people trying to help you and doesn't get your issue or question solved any faster.EHello, the response I'm getting isn't in an accurate json format. Anyone knows how to fix it?
FWhat you get from the API is guaranteed to be valid JSON, but if you ask a LLM to reply with JSON (inside the
response property), it may not work. LLMs are trained to generate text not JSON.F(some very recent advanced LLMs have learned a few JSON tricks, but their responses suffer in quality if you use those)
EThanks. Then, I need help to make my API call return a json. Now, it's returning a string?
FA string is valid JSON, you have to parse it.
EI tried to parse, but because of all the " and , it's not working for me.
EI need to have a way to make the API call return a json without the unneccesary escape characters
FFIf
jq is happy so should any JSON parserEWorkers AI REST API
Ecurl -X POST \
https://api.cloudflare.com/client/v4/accounts/[....]/run/@cf/mistral/mistral-7b-instruct-v0.1 \
-H "Authorization: Bearer [....]" \
-d '{"messages":[{"role":"system","content":"You are a friendly assistant that helps write stories"},{"role":"user","content":"Write a short story about a llama that goes on a journey to find an orange cloud "}]}'
https://api.cloudflare.com/client/v4/accounts/[....]/run/@cf/mistral/mistral-7b-instruct-v0.1 \
-H "Authorization: Bearer [....]" \
-d '{"messages":[{"role":"system","content":"You are a friendly assistant that helps write stories"},{"role":"user","content":"Write a short story about a llama that goes on a journey to find an orange cloud "}]}'
EIt's solved now
