I am starting to consume the lightweight llama model using the Cloudflare API, but where can I see m

I am starting to consume the lightweight llama model using the Cloudflare API, but where can I see my consumption? I do not want to exceed 10,000 neurons per day, and if I exceed that, what happens? (I'm not using worker, I'm consuming the cloudflare API directly)

FFernando Dilland I am starting to consume the lightweight llama model using the Cloudflare API, b...

Fernando DillandOP•9/26/24, 7:55 PM

My question is, do you request them for example: curl https://api.cloudflare.com/client/v4/accounts/$CLOUDFLARE_ACCOUNT_ID/ai/run/@cf/meta/llama-3.2-11b-v...

Where or how can I see my consumption?

Stanleasy•9/27/24, 3:04 AM

the flux model documentation on API schema for input parameters all a sudden got a lot shorter in the couple hours i was afk. there were a bunch of parameters like image size and negative prompts that i don't see anymore
https://developers.cloudflare.com/workers-ai/models/flux-1-schnell

Cloudflare Docs

flux-1-schnell | Cloudflare Workers AI docs

FLUX.1 [schnell] is a 12 billion parameter rectified flow transformer capable of generating images from text descriptions.

Chaika•9/27/24, 3:24 AM

hmm yea https://github.com/cloudflare/cloudflare-docs/pull/17153/files 5h ago

GitHub

update Flux schema by LoganGrasby · Pull Request #17153 · cloudflar...

Summary

Screenshots (optional)

Documentation checklist

The documentation style guide has been adhered to.
If a larger change - such as adding a new page- an issue has been opened in relation ...

twentytwohalo•9/27/24, 6:11 AM

Hi I need an urgent support from you guys.
I have setup cloudflare on my domain (https://www.twentytwohalo.com/) and on Cloudflare dashboard it ask me Nameserver update pending.
I have updated the nameservers on my domain registrar. And now the cloudflare dashboard is showing an active status.

But when I update the nameserver of my hosting company and added A record and CNAME records in cloudflare DNS records (my site goes down and never up again even after waiting several hours).

Below are my domain and hosting companies:
Domain Registrar: Namecheap
Hosting: Dreamhost

Any help would be appreciated.
Thanks

22° H Δ L Oadmin

Home – EVENTS

Ttwentytwohalo Hi I need an urgent support from you guys. I have setup cloudflare on my domain...

dexter•9/27/24, 12:24 PM

I recommend you use another channel for nameservers/domains related question

SStanleasy the flux model documentation on API schema for input parameters all a sudden got...

dexter•9/27/24, 12:24 PM

Flux also returns a 500 error for me and other users in this discord, any idea why?

Tony Leung•9/29/24, 9:48 AM

it seems like seed in all stable diffusion models does not work at all. I'm trying to use the same seed and it all produced different output

Tony Leung•9/29/24, 10:00 AM

am I doing anything wrong :?

DDeleted User i am getting Error: Too many subrequests while running text embedding "@cf/baai/...

Kathy•9/30/24, 8:47 PM

https://developers.cloudflare.com/workers-ai/platform/limits/#text-embeddings

Cloudflare Docs

Limits | Cloudflare Workers AI docs

Workers AI is now Generally Available. We’ve updated our rate limits to reflect this.

CChaika hmm yea https://github.com/cloudflare/cloudflare-docs/pull/17153/files 5h ago

Advany•10/3/24, 8:47 AM

to bad they removed all the options...

kamlesh•10/3/24, 1:18 PM

Hi everyone! Does anyone know how to disable or remove the data-cfsrc tag? It automatically applies on mobile devices.

�

😈 Donkey 💫•10/4/24, 8:02 AM

Tried a test with llama 3.2 vision.
I put an image url of 2.2MB, but somehow the arrayBuffer inside worker inflating the payload that much 10MB then error

    if (attachment) {
        const res = await fetch("https://img.xyz" + attachment).catch(() => null);
        blob = await res?.arrayBuffer();
    }
    const response = await env.AI.run(model as any || '@cf/meta/llama-3.1-8b-instruct', {
        stream: stream,
        messages,
        max_tokens: 512,model (meta llama)
        ...(blob && { image: [...new Uint8Array(blob)] }),
    }

    if (attachment) {
        const res = await fetch("https://img.xyz" + attachment).catch(() => null);
        blob = await res?.arrayBuffer();
    }
    const response = await env.AI.run(model as any || '@cf/meta/llama-3.1-8b-instruct', {
        stream: stream,
        messages,
        max_tokens: 512,model (meta llama)
        ...(blob && { image: [...new Uint8Array(blob)] }),
    }

how can handle this? any limitation docs?

�

😈 Donkey 💫•10/4/24, 8:09 AM

and CF dashboard of gateway hanging too

csmykay•10/4/24, 7:06 PM

Who would we talk to about considering other models to add to the list of models currently listed on CloudFlare?

MarvinKR•10/7/24, 10:10 AM

how does cloudfare ai compares to the vercel ai sdk?

LM•10/7/24, 2:26 PM

exists model ai for detect texts written by ai? For example ZeroGPT

MMarvinKR how does cloudfare ai compares to the vercel ai sdk?

Isaac McFadyen•10/7/24, 4:44 PM

Vercel AI uses third-party providers like OpenAI, Anthropic, etc. Workers AI runs fully on the Cloudflare platform (with the exception of AI Gateway which is designed to use third-party providers).

IIsaac McFadyen Vercel AI uses third-party providers like OpenAI, Anthropic, etc. Workers AI run...

MarvinKR•10/7/24, 4:55 PM

Thanks for explaining this! What are the benefits of running fully on cloudfare?

Lamrin•10/7/24, 4:59 PM

I'm facing this problem in all of my browser becasue of this I'm not able to login into my account from my laptop i even tried contacting offical support team but never got reply from them so please anyone here can help me with his?

someguy•10/7/24, 7:31 PM

Has anyone gotten Vercel AI Package working with streamText and Cloudflare AI models? I am getting the following error and it's only when I am streaming (generateText works fine). I will note I am using a modified baseURL in an OpenAI provider to make CF AI work with Vercel AI package.

"Error message: [
{
"code": "invalid_union",
"unionErrors": [
{
"issues": [
{
"code": "invalid_type",
"expected": "number",
"received": "undefined",
"path": [
"choices",
0,
"index"
],
"message": "Required"
}
],
"name": "ZodError"
},
{
"issues": [
{
"code": "invalid_type",
"expected": "object",
"received": "undefined",
"path": [
"error"
],
"message": "Required"
}
],
"name": "ZodError"
}
],
"path": [],
"message": "Invalid input"
}
]"

Sam•10/9/24, 7:44 AM

Hey is the llama 3.2 90b vision model coming soon to workers AI?

Bentley Hensel•10/10/24, 1:26 AM

Hi! I've got a policy question for about Cloudflare AI. My OpenAI account was recently suspended due to the use of their platform for my political campaign.

Is there any issue with my use of Cloudflare AI for this purpose?

Source code --> https://github.com/HenselForCongress/CandidateGPT

See -->
https://www.reuters.com/world/us/virginia-congressional-candidate-creates-ai-chatbot-debate-stand-in-incumbent-2024-10-08/

GitHub

GitHub - HenselForCongress/CandidateGPT: Ask AI Candidates question...

Ask AI Candidates questions based on their policy stances - HenselForCongress/CandidateGPT

Reuters

Exclusive: Virginia congressional candidate creates AI chatbot as d...

A long-shot congressional challenger in Virginia is so determined to debate the Democratic incumbent one more time that he created an AI chatbot to stand in for the candidate in case he's a no-show.

sedig_b.o•10/13/24, 7:13 PM

yo guys

BBentley Hensel Hi! I've got a policy question for about Cloudflare AI. My OpenAI account was re...

Bentley Hensel•10/16/24, 1:58 PM

Any update on this? I just announced PotusGPT and would prefer not to get my Cloudflare account banned a week before the election. I am a huge fan and user of Cloudflare and don’t want to screw up my relationship with them.

I’ve already migrated over to Cloudflare AI workers but really want to know if this is something I can continue or need to stop.

@Tanmay Kapoor @Vero are you the official CF folks here?

�

😈 Donkey 💫•10/17/24, 4:23 AM

My worker sometimes get this error: Error: AiError: 5010: Couldn't fetch external AI provider response (500, Internal Server Error)Error: AiError: 5010: Couldn't fetch external AI provider response (500, Internal Server Error)

BBentley Hensel Any update on this? I just announced PotusGPT and would prefer not to get my Clo...

Vero•10/17/24, 1:45 PM

Hi. Models have their own terms and usage policies, so I'd suggest that you check the model's own Terms of Service

mukhtharcm•10/18/24, 11:54 AM

Hi,

What's the recommended way to use Cloudflare AI in golang?

I'd like to use the embedded function calling feature :)

iamnogamer•10/19/24, 2:30 PM

Is there something wrong with Cursor, the Cloudflare AI Assistant?

Isaac McFadyen•10/19/24, 3:07 PM

Oof OK, I'll escalate—thank you.

Nolan•10/19/24, 4:55 PM

Sorry for the delay! Taking a look now!

Nolan•10/19/24, 5:08 PM

Reaching out to the workers team

fry69•10/24/24, 2:39 PM

?crossposting

Flare•10/24/24, 2:39 PM

Please do not post your question in multiple channels/post it multiple times per the rules at ⁠No Access. It creates confusion for people trying to help you and doesn't get your issue or question solved any faster.

Avocadio•10/30/24, 10:56 AM

is there any chance to upload my finetuned bert model to cloudflare workers ai

AAvocadio is there any chance to upload my finetuned bert model to cloudflare workers ai

Isaac McFadyen•10/30/24, 3:47 PM

?workers-ai-models See below.

Flare•10/30/24, 3:47 PM

Workers AI currently only supports popular open-source models provided by the Cloudflare team, as well as your own LoRAs that can be applied on top of the Cloudflare-provided models. You cannot currently upload your own models or use a model from HuggingFace. See the documentation for the list of Cloudflare-provided models: https://developers.cloudflare.com/workers-ai/models/

Holly Grey•10/30/24, 7:03 PM

Cloudflare Ray ID: 8dad13fcb9be0100
What does this his id mean?

HHolly Grey Cloudflare Ray ID: 8dad13fcb9be0100 What does this his id mean?

fry69•10/30/24, 7:10 PM

See here -> https://developers.cloudflare.com/fundamentals/reference/cloudflare-ray-id/

Manole•11/5/24, 11:50 PM

hi. I got this message earlier, anyone can help me?

Manole•11/5/24, 11:50 PM

We have determined that one or more of your web properties appears to be serving videos or a disproportionate amount of large files without using the appropriate paid service such as R2, Stream, or Cloudflare Images.
In response, we have temporarily stopped serving some of the traffic at issue. A few of your visitors may experience altered performance until this issue is resolved. If we conclude this issue remains unresolved, we may take further action including continuing to alter performance or deactivating problematic zones from the network.

MManole We have determined that one or more of your web properties appears to be serving...

fry69•11/6/24, 3:19 AM

How is this related to Cloudflare AI?

Manole•11/6/24, 5:13 AM

it s a streaming site

MManole it s a streaming site

fry69•11/6/24, 5:16 AM

Also, please don't crosspost -> r2

if (attachment) { const res = await fetch("https://img.xyz" + attachment).catch(() => null); blob = await res?.arrayBuffer(); } const response = await env.AI.run(model as any || '@cf/meta/llama-3.1-8b-instruct', { stream: stream, messages, max_tokens: 512,model (meta llama) ...(blob && { image: [...new Uint8Array(blob)] }), }

I am starting to consume the lightweight llama model using the Cloudflare API, but where can I see m

Similar Threads