Am I the only one that can't get `@cf/black-forest-labs/flux-1-schnell` to work? Even the short exam

TTanis Wolfbane Any one manage to get flux to work? When I run the exactly example in the docume...

D

DaniFoldi•10/31/24, 7:02 PM

Hey, is anyone else still seeing this with flux?

I

Isaac McFadyen•10/31/24, 7:08 PM

We're going to try escalating it

D

DaniFoldi•10/31/24, 7:10 PM

Isaac has escalated this, we'll let you know if we have any updates

C

Chaika•10/31/24, 7:13 PM

Looks like the example is categorized as nsfw but most other inputs aren't

FFanitullen Am I the only one that can't get `@cf/black-forest-labs/flux-1-schnell` to work?...

R

Raylight•10/31/24, 7:14 PM

The example code doesn't work. Flux returns a json object with the image encoded as base64. So you need to decode it.

RRaylight The example code doesn't work. Flux returns a json object with the image encoded...

F

FanitullenOP•10/31/24, 7:17 PM

Thank you, got it working now.

R

Raylight•10/31/24, 7:31 PM

A lot of prompts triggers the NSFW error. "cyber", "bar", "toe", "arm", "nose", "drill", "boot", "spy", "cow", "chicken" just from trying a few random one word prompts. "a cyberpunk cat" is ok, "cyberpunk cat" isn't.

RRaylight A *lot* of prompts triggers the NSFW error. "cyber", "bar", "toe", "arm", "nose"...

D

DaniFoldi•10/31/24, 9:45 PM

The team is looking into the filter, for the time being they recommend using longer prompts as they are less likely to be caught - they recommend at least 4-5 words

Aajgeiss0702 any idea how I can get more useful error messages? No matter what, I only get `A...

A

ajgeiss0702•10/31/24, 10:08 PM

any ideas?

Original message was deleted

R

Raylight•11/1/24, 9:06 AM

This. Although I wish https://developers.cloudflare.com/workers-ai/privacy/ were more clear. It feels well-intended and as if it is written to provide peace of mind, but "Cloudflare does not use .. to" can be read as "does use, except for these two things" in the same way that "may be stored by Cloudflare if you specifically use a storage service" can be read as "does not store, except if".

R

Raylight•11/1/24, 10:30 AM

Right now, however, I'm more concerned about Cloudflare throwing NSFW errors and wonder if this filter is Cloudflare's own doing, because if so then IMO Cloudflare is on a slippery slope of engaging in content moderation, and I can't find anything about NFSW in terms and conditions. So I would very much like to have some clarity regarding this. Might be raising an "unpopular option" thing here, but well.. I feel it is important.

Original message was deleted

F

fry69•11/1/24, 11:39 AM

?pings

F

Flare•11/1/24, 11:39 AM

Please do not ping community members for non-moderation reasons. Doing so will not solve your issue faster and will make people less likely to want to help you.

RRaylight This. Although I wish <https://developers.cloudflare.com/workers-ai/privacy/> we...

F

FanitullenOP•11/1/24, 5:21 PM

The link you posted defines all input/output as Customer Content. This is a term specified in their Self-Serve Subscription Agreement. Specifically 2.5.1 states Subject to the terms of this Agreement, you hereby grant us a non-exclusive, fully sublicensable, worldwide, royalty-free right to collect, use, copy, store, transmit, modify and create derivative works of Customer Content, in each case to the extent necessary to provide the Services. With the current trend of excessive data retention among AI providers, I would be very hesitant to assume any sort of privacy regarding the use of these services. At least I find it hard to read it any other way.

A

ac•11/2/24, 3:39 PM

I am noticing a large number of AiError: 3001: Unknown internal error s when doing some AI/Vectorize queries (I believe when creating embeddings). Is there any way to get more insight into what these are? I have no clue if it's not able to get the model, if I'm getting rate limited, or if it's something I can control

LLogan Grasby We definitely don't intend to moderate content and we'll hopefully add documenta...

R

Raylight•11/2/24, 8:27 PM

That's very helpful and reassuring. Thanks for replying!

Aajgeiss0702 any idea how I can get more useful error messages? No matter what, I only get `A...

A

ajgeiss0702•11/2/24, 9:57 PM

?

LLogan Grasby This is long overdue some attention and we have some big updates coming soon! I ...

A

ajgeiss0702•11/2/24, 11:58 PM

thank you!

A

ajgeiss0702•11/2/24, 11:58 PM

alread been trying this on and off for months, another week wont hurt

LLogan Grasby Try out this text to speech model ```@cf/myshell-ai/melotts``` With inputs ```{p...

A

ajgeiss0702•11/3/24, 12:42 AM

what is the format of the output?

Aajgeiss0702 what is the format of the output?

R

Raylight•11/3/24, 7:39 AM

base64-encoded WAV. (

{ audio: "UklGRl4VAQBXQVZFZm10 ...... " }

{ audio: "UklGRl4VAQBXQVZFZm10 ...... " }

{ audio: "UklGRl4VAQBXQVZFZm10 ...... " }

{ audio: "UklGRl4VAQBXQVZFZm10 ...... " })

P

patentmaster•11/3/24, 2:52 PM

Hi I need someone to help me connect my API endpoints with Adobe Express

J

Jumaron•11/5/24, 7:14 AM

Would love to see the Huggingface Model NousResearch/Hermes-3-Llama-3.1-8B instead of @hf/nousresearch/hermes-2-pro-mistral-7b
Since it is newer, more used and i see no reason why you should not use it instead. Thanks

B

Ben-xD•11/5/24, 6:08 PM

is there a way to check the context length of models hosted on cf? Or the quantization? Are they extra quantized than regular models of the same name on huggingface/ollamaa?

C

cosmos•11/6/24, 7:39 AM

hi guys is there a way I can add like 80KB worth of text as instructions to the AI -- KV, D1 maybe?

Ccosmos hi guys is there a way I can add like 80KB worth of text as instructions to the ...

F

fry69•11/6/24, 7:56 AM

In a constant variable If those instructions change only on build time at worst? Otherwise D1, KV, R2 depending on your needs.

A

Ali_hat•11/6/24, 9:48 PM

Hey guys, we're using the Workers AI REST API (

llama-3.1-70b-instruct

llama-3.1-70b-instruct

llama-3.1-70b-instruct

llama-3.1-70b-instruct) and, for some reason, I'm currently unable to see in Cloudflare dashboard how much we've been consuming. Any ideas?

B

boommachine•11/8/24, 5:34 AM

how to generate custom sized images instead of square shaped using flux in cloudfare ai?

M

maahin•11/8/24, 6:46 AM

How to check models accuracy which has been provided by cloudflare as in analytics it provides me request and errors of api call

Ccosmos hi guys is there a way I can add like 80KB worth of text as instructions to the ...

M

maahin•11/8/24, 6:47 AM

You can pass it as chunks

B

Brandon Studio•11/11/24, 2:15 AM

Would Workers AI allow cross-origin request?

0

0x7d8•11/11/24, 5:43 PM

do workers stay online after a request is made to handle further requests or do they get shutdown instantly?

00x7d8 do workers stay online after a request is made to handle further requests or do ...

F

fry69•11/11/24, 5:45 PM

Usually workers exit when they have done their work

I

Isaac McFadyen•11/11/24, 6:42 PM

^ they can stay online for a little bit but different users will likely hit different servers (meaning they won't hit the same Worker) and Workers are not guaranteed to stay online at all.

A

Advany•11/12/24, 8:20 AM

Can we please get... Qwen2.5-Coder-32B-Instruct on cloudflare AI?

S

Sean•11/12/24, 9:29 AM

Can anyone make LoRA adapters work? I'm constantly getting

{"errors":[{"message":"AiError: AiError: Unknown internal error","code":3028}],"success":false,"result":{},"messages":[]}

{"errors":[{"message":"AiError: AiError: Unknown internal error","code":3028}],"success":false,"result":{},"messages":[]}

{"errors":[{"message":"AiError: AiError: Unknown internal error","code":3028}],"success":false,"result":{},"messages":[]}

{"errors":[{"message":"AiError: AiError: Unknown internal error","code":3028}],"success":false,"result":{},"messages":[]}

. The example from the docs doesn't work either https://developers.cloudflare.com/workers-ai/fine-tunes/public-loras/ . Tried the cURL command using my token, same error. Saw a few messages related to this before, but seems like there aren't any solution yet.

Cloudflare Docs

Public LoRA adapters | Cloudflare Workers AI docs

Cloudflare offers a few public LoRA adapters that are immediately ready for use.

�

😈 Donkey 💫•11/13/24, 6:04 AM

the ony one supports function: @hf/nousresearch/hermes-2-pro-mistral-7b so terrible?
it even retrieves kind of tool_calls which is not in pre-defined list

const tool_response = await env.AI.run(
    "@hf/nousresearch/hermes-2-pro-mistral-7b",
    {
        messages: [
            { role: "user", content: query },
        ],
        temperature: 0.2,
        tools: [
            {
                type: "function",
                function: {
                    name: "get-weather",
                    description: "Gets weather information of a particular city",
                    parameters: {
                        type: "object",
                        properties: {
                            city: {
                                type: "string",
                                description: "The city name",
                            },
                            country: {
                                type: "string",
                                description: "The country name",
                            }
                        },
                        required: ["city"],
                    }
                }
            },
            {
                type: "function",
                function: {
                    name: "search-google",
                    description: "Gets general data from Google",
                    parameters: {
                        type: "object",
                        properties: {
                            keyword: {
                                type: "string",
                                description: "The keywords for searching",
                            },
                        },
                        required: ["keyword"],
                    }
                }
            },
        ],
    }
);

const selected_tool = tool_response?.tool_calls?.[0];
console.log({ selected_tool });

const tool_response = await env.AI.run(
    "@hf/nousresearch/hermes-2-pro-mistral-7b",
    {
        messages: [
            { role: "user", content: query },
        ],
        temperature: 0.2,
        tools: [
            {
                type: "function",
                function: {
                    name: "get-weather",
                    description: "Gets weather information of a particular city",
                    parameters: {
                        type: "object",
                        properties: {
                            city: {
                                type: "string",
                                description: "The city name",
                            },
                            country: {
                                type: "string",
                                description: "The country name",
                            }
                        },
                        required: ["city"],
                    }
                }
            },
            {
                type: "function",
                function: {
                    name: "search-google",
                    description: "Gets general data from Google",
                    parameters: {
                        type: "object",
                        properties: {
                            keyword: {
                                type: "string",
                                description: "The keywords for searching",
                            },
                        },
                        required: ["keyword"],
                    }
                }
            },
        ],
    }
);

const selected_tool = tool_response?.tool_calls?.[0];
console.log({ selected_tool });

const tool_response = await env.AI.run(
    "@hf/nousresearch/hermes-2-pro-mistral-7b",
    {
        messages: [
            { role: "user", content: query },
        ],
        temperature: 0.2,
        tools: [
            {
                type: "function",
                function: {
                    name: "get-weather",
                    description: "Gets weather information of a particular city",
                    parameters: {
                        type: "object",
                        properties: {
                            city: {
                                type: "string",
                                description: "The city name",
                            },
                            country: {
                                type: "string",
                                description: "The country name",
                            }
                        },
                        required: ["city"],
                    }
                }
            },
            {
                type: "function",
                function: {
                    name: "search-google",
                    description: "Gets general data from Google",
                    parameters: {
                        type: "object",
                        properties: {
                            keyword: {
                                type: "string",
                                description: "The keywords for searching",
                            },
                        },
                        required: ["keyword"],
                    }
                }
            },
        ],
    }
);

const selected_tool = tool_response?.tool_calls?.[0];
console.log({ selected_tool });

const tool_response = await env.AI.run(
    "@hf/nousresearch/hermes-2-pro-mistral-7b",
    {
        messages: [
            { role: "user", content: query },
        ],
        temperature: 0.2,
        tools: [
            {
                type: "function",
                function: {
                    name: "get-weather",
                    description: "Gets weather information of a particular city",
                    parameters: {
                        type: "object",
                        properties: {
                            city: {
                                type: "string",
                                description: "The city name",
                            },
                            country: {
                                type: "string",
                                description: "The country name",
                            }
                        },
                        required: ["city"],
                    }
                }
            },
            {
                type: "function",
                function: {
                    name: "search-google",
                    description: "Gets general data from Google",
                    parameters: {
                        type: "object",
                        properties: {
                            keyword: {
                                type: "string",
                                description: "The keywords for searching",
                            },
                        },
                        required: ["keyword"],
                    }
                }
            },
        ],
    }
);

const selected_tool = tool_response?.tool_calls?.[0];
console.log({ selected_tool });

�

😈 Donkey 💫•11/13/24, 6:04 AM

  selected_tool: {
    arguments: { from_currency: 'USD', to_currency: 'CNY' },
    name: 'get-currency-exchange-rate'
  }

  selected_tool: {
    arguments: { from_currency: 'USD', to_currency: 'CNY' },
    name: 'get-currency-exchange-rate'
  }

  selected_tool: {
    arguments: { from_currency: 'USD', to_currency: 'CNY' },
    name: 'get-currency-exchange-rate'
  }

  selected_tool: {
    arguments: { from_currency: 'USD', to_currency: 'CNY' },
    name: 'get-currency-exchange-rate'
  }

C

catnaut.•11/13/24, 11:40 AM

News for multilingual embedding model ?

Am I the only one that can't get `@cf/black-forest-labs/flux-1-schnell` to work? Even the short exam

Similar Threads

Similar Threads

Similar Threads