Notice how the completion_tokens are 256; the model wasn't actually done, but got cut off because ma

J

JoaoCupido•3/13/25, 6:34 PM

Speaking of max_tokens, I can't seem to change max_tokens with the messages property in any chat model, and I have no clue why. I have done this via URL (api.cloudflare.com/client/v4/accounts/$CLOUDFLARE_ACCOUNT_ID/ai/run/@cf/meta/llama-3-8b-instruct).

IIsaac McFadyen Notice how the completion_tokens are 256; the model wasn't actually done, but go...

D

dmaretskyi•3/13/25, 7:06 PM

hi, thanks for the suggestion! I've increased the token count to 4096 and this is the response I get now:

(info) generateCloudflare {
  stream: {
    response: 'Okay, so I need to make a cup of Earl Grey tea using the tools provided. Hmm, let me think about what tools I might have. Usually, when making tea, you need a kettle, a teapot, a teacup, tea bags or loose tea, hot water, maybe a strainer, and sugar or milk if you want it. \n' +
      '\n' +
      "Wait, the user said to use the tool provided, but didn't specify what that tool is. Maybe it's just a regular teapot? Or maybe a tea infuser? I'm not sure. Well, I guess I'll go with the basics.\n" +
      '\n' +
      "First, I should probably boil some water. If I have a kettle, I can fill it with water and turn it on. While the water is boiling, I can prepare the teapot. If I'm using loose tea, I'll need a tea infuser or a strainer to prevent the leaves from getting into the cup. \n" +
      '\n' +
      "Once the water is boiling, I should let it cool a bit because Earl Grey tea is best when brewed with water that's just below boiling point, maybe around 90-95 degrees Celsius. If I pour boiling water directly on the tea, it might make it too strong or bitter. \n" +
      '\n' +
      "So, I'll pour a little bit of hot water into the teapot to warm it up and then discard that water. Then, I'll add the tea leaves or the tea bag. If I'm using loose tea, I'll put the infuser in the teapot. For a standard cup, maybe about a teaspoon of loose tea or one tea bag. \n" +
      '\n' +
      "Next, I'll pour the hot water over the tea. I'll make sure to cover the teapot to keep the heat in. The steeping time is important. Earl Grey usually takes about 3-5 minutes. If I steep it too long, it might become too strong.\n" +
      '\n' +
      "After steeping, I'll pour the tea into the cup. If I used an infuser, I'll remove it now. I can add sugar or honey if I want it sweet, or maybe a splash of milk. Some people like it with lemon, so that's an option too.\n" +
      '\n' +
      "Wait, did I forget anything? Oh, maybe I should consider the type of cup. If it's a ceramic cup, that's good for retaining heat. Glass might be nice if I want to see the tea. Also, maybe I should clean the teapot and tools afterwards to keep them ready for next time.\n" +
      '\n' +
      "I think that's the basic process. Let me summarize the steps to make sure I didn't miss anything.\n" +
      '</think>\n' +
      '\n' +
      'To make a cup of Earl Grey tea, follow these organized steps:\n' +
      '\n' +
      '1. **Boil Water**: Fill a kettle with water and bring it to a boil. Allow the water to cool slightly to around 90-95°C (194-203°F) to avoid bitterness.\n' +
      '\n' +
      '2. **Prepare the Teapot**: Warm the teapot by pouring a small amount of hot water into it, then discard the water.\n' +
      '\n' +
      '3. **Add Tea**: Place 1 teaspoon of loose Earl Grey tea leaves into a tea infuser or add one Earl Grey tea bag to the teapot.\n' +
      '\n' +
      '4. **Steep the Tea**: Pour the hot water over the tea and cover the teapot. Steep for 3-5 minutes to achieve the desired strength.\n' +
      '\n' +
      '5. **Serve**: Carefully pour the tea into a cup. Remove the infuser or tea bag.\n' +
      '\n' +
      '6. **Customize**: Add sugar, honey, milk, or lemon as preferred.\n' +
      '\n' +
      '7. **Clean Up**: Rinse the teapot and infuser to keep them ready for future use.\n' +
      '\n' +
      'Enjoy your Earl Grey tea!',
    usage: { prompt_tokens: 20, completion_tokens: 761, total_tokens: 781 }
  }
}

(info) generateCloudflare {
  stream: {
    response: 'Okay, so I need to make a cup of Earl Grey tea using the tools provided. Hmm, let me think about what tools I might have. Usually, when making tea, you need a kettle, a teapot, a teacup, tea bags or loose tea, hot water, maybe a strainer, and sugar or milk if you want it. \n' +
      '\n' +
      "Wait, the user said to use the tool provided, but didn't specify what that tool is. Maybe it's just a regular teapot? Or maybe a tea infuser? I'm not sure. Well, I guess I'll go with the basics.\n" +
      '\n' +
      "First, I should probably boil some water. If I have a kettle, I can fill it with water and turn it on. While the water is boiling, I can prepare the teapot. If I'm using loose tea, I'll need a tea infuser or a strainer to prevent the leaves from getting into the cup. \n" +
      '\n' +
      "Once the water is boiling, I should let it cool a bit because Earl Grey tea is best when brewed with water that's just below boiling point, maybe around 90-95 degrees Celsius. If I pour boiling water directly on the tea, it might make it too strong or bitter. \n" +
      '\n' +
      "So, I'll pour a little bit of hot water into the teapot to warm it up and then discard that water. Then, I'll add the tea leaves or the tea bag. If I'm using loose tea, I'll put the infuser in the teapot. For a standard cup, maybe about a teaspoon of loose tea or one tea bag. \n" +
      '\n' +
      "Next, I'll pour the hot water over the tea. I'll make sure to cover the teapot to keep the heat in. The steeping time is important. Earl Grey usually takes about 3-5 minutes. If I steep it too long, it might become too strong.\n" +
      '\n' +
      "After steeping, I'll pour the tea into the cup. If I used an infuser, I'll remove it now. I can add sugar or honey if I want it sweet, or maybe a splash of milk. Some people like it with lemon, so that's an option too.\n" +
      '\n' +
      "Wait, did I forget anything? Oh, maybe I should consider the type of cup. If it's a ceramic cup, that's good for retaining heat. Glass might be nice if I want to see the tea. Also, maybe I should clean the teapot and tools afterwards to keep them ready for next time.\n" +
      '\n' +
      "I think that's the basic process. Let me summarize the steps to make sure I didn't miss anything.\n" +
      '</think>\n' +
      '\n' +
      'To make a cup of Earl Grey tea, follow these organized steps:\n' +
      '\n' +
      '1. **Boil Water**: Fill a kettle with water and bring it to a boil. Allow the water to cool slightly to around 90-95°C (194-203°F) to avoid bitterness.\n' +
      '\n' +
      '2. **Prepare the Teapot**: Warm the teapot by pouring a small amount of hot water into it, then discard the water.\n' +
      '\n' +
      '3. **Add Tea**: Place 1 teaspoon of loose Earl Grey tea leaves into a tea infuser or add one Earl Grey tea bag to the teapot.\n' +
      '\n' +
      '4. **Steep the Tea**: Pour the hot water over the tea and cover the teapot. Steep for 3-5 minutes to achieve the desired strength.\n' +
      '\n' +
      '5. **Serve**: Carefully pour the tea into a cup. Remove the infuser or tea bag.\n' +
      '\n' +
      '6. **Customize**: Add sugar, honey, milk, or lemon as preferred.\n' +
      '\n' +
      '7. **Clean Up**: Rinse the teapot and infuser to keep them ready for future use.\n' +
      '\n' +
      'Enjoy your Earl Grey tea!',
    usage: { prompt_tokens: 20, completion_tokens: 761, total_tokens: 781 }
  }
}

(info) generateCloudflare {
  stream: {
    response: 'Okay, so I need to make a cup of Earl Grey tea using the tools provided. Hmm, let me think about what tools I might have. Usually, when making tea, you need a kettle, a teapot, a teacup, tea bags or loose tea, hot water, maybe a strainer, and sugar or milk if you want it. \n' +
      '\n' +
      "Wait, the user said to use the tool provided, but didn't specify what that tool is. Maybe it's just a regular teapot? Or maybe a tea infuser? I'm not sure. Well, I guess I'll go with the basics.\n" +
      '\n' +
      "First, I should probably boil some water. If I have a kettle, I can fill it with water and turn it on. While the water is boiling, I can prepare the teapot. If I'm using loose tea, I'll need a tea infuser or a strainer to prevent the leaves from getting into the cup. \n" +
      '\n' +
      "Once the water is boiling, I should let it cool a bit because Earl Grey tea is best when brewed with water that's just below boiling point, maybe around 90-95 degrees Celsius. If I pour boiling water directly on the tea, it might make it too strong or bitter. \n" +
      '\n' +
      "So, I'll pour a little bit of hot water into the teapot to warm it up and then discard that water. Then, I'll add the tea leaves or the tea bag. If I'm using loose tea, I'll put the infuser in the teapot. For a standard cup, maybe about a teaspoon of loose tea or one tea bag. \n" +
      '\n' +
      "Next, I'll pour the hot water over the tea. I'll make sure to cover the teapot to keep the heat in. The steeping time is important. Earl Grey usually takes about 3-5 minutes. If I steep it too long, it might become too strong.\n" +
      '\n' +
      "After steeping, I'll pour the tea into the cup. If I used an infuser, I'll remove it now. I can add sugar or honey if I want it sweet, or maybe a splash of milk. Some people like it with lemon, so that's an option too.\n" +
      '\n' +
      "Wait, did I forget anything? Oh, maybe I should consider the type of cup. If it's a ceramic cup, that's good for retaining heat. Glass might be nice if I want to see the tea. Also, maybe I should clean the teapot and tools afterwards to keep them ready for next time.\n" +
      '\n' +
      "I think that's the basic process. Let me summarize the steps to make sure I didn't miss anything.\n" +
      '</think>\n' +
      '\n' +
      'To make a cup of Earl Grey tea, follow these organized steps:\n' +
      '\n' +
      '1. **Boil Water**: Fill a kettle with water and bring it to a boil. Allow the water to cool slightly to around 90-95°C (194-203°F) to avoid bitterness.\n' +
      '\n' +
      '2. **Prepare the Teapot**: Warm the teapot by pouring a small amount of hot water into it, then discard the water.\n' +
      '\n' +
      '3. **Add Tea**: Place 1 teaspoon of loose Earl Grey tea leaves into a tea infuser or add one Earl Grey tea bag to the teapot.\n' +
      '\n' +
      '4. **Steep the Tea**: Pour the hot water over the tea and cover the teapot. Steep for 3-5 minutes to achieve the desired strength.\n' +
      '\n' +
      '5. **Serve**: Carefully pour the tea into a cup. Remove the infuser or tea bag.\n' +
      '\n' +
      '6. **Customize**: Add sugar, honey, milk, or lemon as preferred.\n' +
      '\n' +
      '7. **Clean Up**: Rinse the teapot and infuser to keep them ready for future use.\n' +
      '\n' +
      'Enjoy your Earl Grey tea!',
    usage: { prompt_tokens: 20, completion_tokens: 761, total_tokens: 781 }
  }
}

(info) generateCloudflare {
  stream: {
    response: 'Okay, so I need to make a cup of Earl Grey tea using the tools provided. Hmm, let me think about what tools I might have. Usually, when making tea, you need a kettle, a teapot, a teacup, tea bags or loose tea, hot water, maybe a strainer, and sugar or milk if you want it. \n' +
      '\n' +
      "Wait, the user said to use the tool provided, but didn't specify what that tool is. Maybe it's just a regular teapot? Or maybe a tea infuser? I'm not sure. Well, I guess I'll go with the basics.\n" +
      '\n' +
      "First, I should probably boil some water. If I have a kettle, I can fill it with water and turn it on. While the water is boiling, I can prepare the teapot. If I'm using loose tea, I'll need a tea infuser or a strainer to prevent the leaves from getting into the cup. \n" +
      '\n' +
      "Once the water is boiling, I should let it cool a bit because Earl Grey tea is best when brewed with water that's just below boiling point, maybe around 90-95 degrees Celsius. If I pour boiling water directly on the tea, it might make it too strong or bitter. \n" +
      '\n' +
      "So, I'll pour a little bit of hot water into the teapot to warm it up and then discard that water. Then, I'll add the tea leaves or the tea bag. If I'm using loose tea, I'll put the infuser in the teapot. For a standard cup, maybe about a teaspoon of loose tea or one tea bag. \n" +
      '\n' +
      "Next, I'll pour the hot water over the tea. I'll make sure to cover the teapot to keep the heat in. The steeping time is important. Earl Grey usually takes about 3-5 minutes. If I steep it too long, it might become too strong.\n" +
      '\n' +
      "After steeping, I'll pour the tea into the cup. If I used an infuser, I'll remove it now. I can add sugar or honey if I want it sweet, or maybe a splash of milk. Some people like it with lemon, so that's an option too.\n" +
      '\n' +
      "Wait, did I forget anything? Oh, maybe I should consider the type of cup. If it's a ceramic cup, that's good for retaining heat. Glass might be nice if I want to see the tea. Also, maybe I should clean the teapot and tools afterwards to keep them ready for next time.\n" +
      '\n' +
      "I think that's the basic process. Let me summarize the steps to make sure I didn't miss anything.\n" +
      '</think>\n' +
      '\n' +
      'To make a cup of Earl Grey tea, follow these organized steps:\n' +
      '\n' +
      '1. **Boil Water**: Fill a kettle with water and bring it to a boil. Allow the water to cool slightly to around 90-95°C (194-203°F) to avoid bitterness.\n' +
      '\n' +
      '2. **Prepare the Teapot**: Warm the teapot by pouring a small amount of hot water into it, then discard the water.\n' +
      '\n' +
      '3. **Add Tea**: Place 1 teaspoon of loose Earl Grey tea leaves into a tea infuser or add one Earl Grey tea bag to the teapot.\n' +
      '\n' +
      '4. **Steep the Tea**: Pour the hot water over the tea and cover the teapot. Steep for 3-5 minutes to achieve the desired strength.\n' +
      '\n' +
      '5. **Serve**: Carefully pour the tea into a cup. Remove the infuser or tea bag.\n' +
      '\n' +
      '6. **Customize**: Add sugar, honey, milk, or lemon as preferred.\n' +
      '\n' +
      '7. **Clean Up**: Rinse the teapot and infuser to keep them ready for future use.\n' +
      '\n' +
      'Enjoy your Earl Grey tea!',
    usage: { prompt_tokens: 20, completion_tokens: 761, total_tokens: 781 }
  }
}

D

dmaretskyi•3/13/25, 7:07 PM

I noticed that the opening <think> tag is missing

D

dmaretskyi•3/13/25, 7:07 PM

but also the model doesn't seem to recognize that it has access to a tool

I

Isaac McFadyenOP•3/13/25, 7:13 PM

Hmm yeah. Interesting.

I

Isaac McFadyenOP•3/13/25, 7:14 PM

Not sure about the latter but I'm guessing the leading <think> tag is missing because it's part of the prompt used by Workers AI (this is what tools like llama.cpp do in order to force the model to start it's response with thinking).

I

Isaac McFadyenOP•3/13/25, 7:14 PM

That said, for compatibility it should be manually added by Workers AI if it's part of the prompt.

I

Isaac McFadyenOP•3/13/25, 7:14 PM

CC @michelle ^ not 100% sure that's what's happening, but since multiple users are running into this it might be worth a bug fix

IIsaac McFadyen CC @michelle ^ not 100% sure that's what's happening, but since multiple users a...

I

Isaac McFadyenOP•3/14/25, 5:16 AM

Per https://huggingface.co/blog/open-r1/update-3

Incidentally, this is also what DeepSeek does with their distilled models

So yes, guessing that the <think> tag is just being prefilled and Workers AI isn't adding it back into the response.

K

karenr•3/14/25, 5:47 AM

quick question. from the cloudflare workers ai, what's the best model for image compression?

Kkarenr quick question. from the cloudflare workers ai, what's the best model for image ...

T

Torianna•3/14/25, 10:50 AM

You wouldn't want to use AI to compress, you'd want to use something like WebP, AVIF, etc

T

Torianna•3/14/25, 10:50 AM

Those repackage your image into a smaller file, while keeping about the same quality

T

Torianna•3/14/25, 10:52 AM

Now if you want to compress inside Workers, that's a little bit more tricky, but you can look up Cloudflare Images. You get free (I think) image transformations so long as you don't store images there

TTorianna You wouldn't want to use AI to compress, you'd want to use something like WebP, ...

K

karenr•3/14/25, 10:57 AM

Yeah, this is what I actually did. was wondering if using AI for compression is a better choice. Thanks @Torianna

T

Torianna•3/14/25, 10:57 AM

I don't think there's any public models

T

Torianna•3/14/25, 10:58 AM

I know Google is working on one, but that's internal

K

karenr•3/14/25, 11:01 AM

Google - oh really?
yeah.. current models are multimodal AI model with both vision and language capabilities not specific to compression

TTorianna I don't think there's any public models

I

Isaac McFadyenOP•3/14/25, 3:24 PM

Nvidia has one and it's teeeechnically public but not really? i.e. it's integrated into their new Neural Shader stuff but I don't believe the model is open-weight.

IIsaac McFadyen CC @michelle ^ not 100% sure that's what's happening, but since multiple users a...

D

dmaretskyi•3/14/25, 3:25 PM

do you have a public bug tracker for this?

D

dmaretskyi•3/14/25, 3:25 PM

just so I can check when this gets resolved

Ddmaretskyi do you have a public bug tracker for this?

I

Isaac McFadyenOP•3/14/25, 3:25 PM

Nope but if I don't hear back from Michelle in a while I can try to escalate to others.

D

dmaretskyi•3/14/25, 3:25 PM

okay, thanks for your help!

Ddmaretskyi okay, thanks for your help!

I

Isaac McFadyenOP•3/14/25, 3:26 PM

I'm not sure if R1 works well with tools at all, based on what I've heard. But the missing opening <think> is probably a bug, I can't imagine it's intended.

J

JoaoCupido•3/14/25, 7:45 PM

Flux Schnell model still doesn't have a random seed implementation and image sizes (width x height), unlike Stable Diffusion models. When is this going to be implemented, if possible?

B

blindChicken•3/16/25, 5:58 PM

Has there been a change to the

hermes-2-pro-mistral-7b

hermes-2-pro-mistral-7b

model. I have a very basic app based on CF's function calling tutorial. I made the app about a month ago and has been working fine since. But over the past few days it has stopped working and it appears that the model has changed the format of its response. Here is how it is responding now:

User Prompt: show me the color of an avocado?
AI result is: {
  response: '<tool_call>\n' +
    "{'arguments': {'r': 69, 'g': 139, 'b': 69}, 'name': 'switchLightColor'}\n" +
    '</tool_call>\n' +
    '\n' +
    'I have chosen a color that represents an avocado. The color of an avocado is typically a pale green with a hint of creaminess. To represent this, I have selected a color with a higher green value (139) and balanced amounts of red (69) and blue (69) values. This creates a color that is reminiscent of the natural hue of an avocado, bringing the essence of the fruit into the room.',
  usage: { prompt_tokens: 0, completion_tokens: 0, total_tokens: 0 }
}

User Prompt: show me the color of an avocado?
AI result is: {
  response: '<tool_call>\n' +
    "{'arguments': {'r': 69, 'g': 139, 'b': 69}, 'name': 'switchLightColor'}\n" +
    '</tool_call>\n' +
    '\n' +
    'I have chosen a color that represents an avocado. The color of an avocado is typically a pale green with a hint of creaminess. To represent this, I have selected a color with a higher green value (139) and balanced amounts of red (69) and blue (69) values. This creates a color that is reminiscent of the natural hue of an avocado, bringing the essence of the fruit into the room.',
  usage: { prompt_tokens: 0, completion_tokens: 0, total_tokens: 0 }
}

User Prompt: show me the color of an avocado?
AI result is: {
  response: '<tool_call>\n' +
    "{'arguments': {'r': 69, 'g': 139, 'b': 69}, 'name': 'switchLightColor'}\n" +
    '</tool_call>\n' +
    '\n' +
    'I have chosen a color that represents an avocado. The color of an avocado is typically a pale green with a hint of creaminess. To represent this, I have selected a color with a higher green value (139) and balanced amounts of red (69) and blue (69) values. This creates a color that is reminiscent of the natural hue of an avocado, bringing the essence of the fruit into the room.',
  usage: { prompt_tokens: 0, completion_tokens: 0, total_tokens: 0 }
}

User Prompt: show me the color of an avocado?
AI result is: {
  response: '<tool_call>\n' +
    "{'arguments': {'r': 69, 'g': 139, 'b': 69}, 'name': 'switchLightColor'}\n" +
    '</tool_call>\n' +
    '\n' +
    'I have chosen a color that represents an avocado. The color of an avocado is typically a pale green with a hint of creaminess. To represent this, I have selected a color with a higher green value (139) and balanced amounts of red (69) and blue (69) values. This creates a color that is reminiscent of the natural hue of an avocado, bringing the essence of the fruit into the room.',
  usage: { prompt_tokens: 0, completion_tokens: 0, total_tokens: 0 }
}

The tool call is being returned within the response and is correctly tagged with

<tool_call>

<tool_call>

but the response no longer returns a

tool_calls

tool_calls

prop, so my code isn't calling anything it only shows the malformed response.

B

blindChicken•3/16/25, 6:11 PM

If I replace

hermes-2-pro-mistral-7b

hermes-2-pro-mistral-7b

with

@cf/meta/llama-3.3-70b-instruct-fp8-fast

@cf/meta/llama-3.3-70b-instruct-fp8-fast

then it works fine. Something must have changed with the Mistral model

K

kalepail•3/16/25, 7:58 PM

I'm trying to use the

@cf/meta/llama-guard-3-8b

@cf/meta/llama-guard-3-8b

. What's the proper way to tweak this to modify the

UNSAFE CONTENT CATEGORIES

UNSAFE CONTENT CATEGORIES

? A lot of sexually explict stuff is getting through when the prompts aren't very long. I want a really robust NSFW content filter but asis this model isn't working well

BblindChicken Has there been a change to the `hermes-2-pro-mistral-7b` model. I have a very ba...

J

James•3/16/25, 8:26 PM

cc @michelle possible breaking change or incident with tool calling for this model?

J

James•3/16/25, 8:44 PM

@Isaac | AS213339 confirmed the regression and has raised an escalation with the team. Thanks for the report.

JJames @Isaac | AS213339 confirmed the regression and has raised an escalation with the...

I

Isaac McFadyenOP•3/16/25, 8:45 PM

^ Oh yes, thanks for mentioning; forgot to say that here.

H

Houston CF•3/16/25, 9:58 PM

@blindChicken @Isaac | AS213339 @James Are we seeing the results we expected now? We have deployed a fix for the " tool calling using hermes-2-pro-mistral-7b model" issue.

J

James•3/16/25, 9:59 PM

Looks good now, thank you!

JJames Looks good now, thank you!

B

blindChicken•3/17/25, 1:17 AM

We just tested it on our end and it appears to be working correctly. Thanks!

M

markvaldez•3/17/25, 6:11 PM

Hi, I don't see any way to rotate my REST bearer AI token..

M

markvaldez•3/17/25, 6:14 PM

I didn't create a token, it was created for me on the dashboard when I went to the AI Worker page

M

markvaldez•3/17/25, 6:39 PM

I applied as an Engineer at Cloudflare this past month, but I don't think I got past the resume screen. I live around the corner from the SF offices and have been there for a hackathon and lunch-and-learn HONO event the past 2 weeks. I can fix this issue: https://github.com/valdezm/dash.cloudflare.com/issues/1

GitHub

Cannot rotate REST AI Bearer token · Issue #1 · valdezm/dash.cloudf...

Problem A REST Bearer token was created for me and does not show up in my Account API Tokens using these instructions: https://developers.cloudflare.com/workers-ai/get-started/rest-api/#1-get-api-t...

M

markvaldez•3/17/25, 6:40 PM

https://tenor.com/view/bills-ugh-gif-9811803164280522639

Tenor

M

markvaldez•3/17/25, 6:41 PM

Send me a DM and I will happliy get to work

M

markvaldez•3/17/25, 6:43 PM

Also, you all are awesome

A

Alex Patterson•3/20/25, 3:30 AM

Seems like all the models on Workers AI have such small Context WIndows, is there any that will be added that come closer to Google Gemini?

S

si(dot).xth•3/20/25, 11:30 AM

my pillow fixed my issue:

raw data for simplicity and efficiency in handling large images, this method may lead to more API calls if the image is re-generated each time it's accessed (Caching handles that last part.)

base64 encoding to minimize API calls over performance (Easier to implement)

Raw data + cache is the only way to go

Original: Blob not supported for workers ai? URL.CreateObjectURL() is not implemented

AAlex Patterson Seems like all the models on Workers AI have such small Context WIndows, is ther...

S

Silvan•3/20/25, 12:01 PM

Having the same issue here. Trying to create a story is fairly hard this way but some models do have bigger context windows but many of the "good ones" are less than 10k

J

JMPA•3/20/25, 9:14 PM

hello, is inpaiting ai workers working currently?

J

JMPA•3/20/25, 9:15 PM

i tried 2 models and they dont works.

J

JMPA•3/20/25, 9:16 PM

stable-diffusion-v1-5-inpainting
API response status: 400 body: {"errors":[{"message":"AiError: Bad input: Error: Type mismatch of '/mask', 'array' not in 'string'","code":5006}],"success":false,"result":{},"messages":[]}
API error: 400 - {"errors":[{"message":"AiError: Bad input: Error: Type mismatch of '/mask', 'array' not in 'string'","code":5006}],"success":false,"result":{},"messages":[]}
Response with status 400 in 1363 ms.

J

JMPA•3/20/25, 10:19 PM

anyone there?

J

James•3/20/25, 10:27 PM

Is this something that worked previously and now doesn't? Can you provide any code to reproduce?

JJMPA hello, is inpaiting ai workers working currently?

R

Raylight•3/22/25, 6:59 AM

As James implied, it would be easier to help if you have a snippet showing the call to the model, but in general: The docs show the same set of parameters (e.g.

image

image

,

mask

mask

) for several models, but the only model that does inpainting is

@cf/runwayml/stable-diffusion-v1-5-inpainting

@cf/runwayml/stable-diffusion-v1-5-inpainting

.
Make sure to supply both

image

image

and

mask

mask

when calling it. The format is

mask: [...new Uint8Array(await maskImage.arrayBuffer())]

mask: [...new Uint8Array(await maskImage.arrayBuffer())]

, where

maskImage

maskImage

could be the result of e.g.

await fetch(/* mask image url */)

await fetch(/* mask image url */)

.

S

Silvan•3/23/25, 11:09 AM

I really hope we get some “better” text generation models on here soon. i tried every single one for story creation and nothing came even remotely close to claude atm.

O

ochrons•3/23/25, 3:37 PM

I'm using

@cf/openai/whisper-large-v3-turbo

@cf/openai/whisper-large-v3-turbo

to convert audio into text. It works fine when recording on Pixel 9 in AAC format, but fails when recording on an older Oneplus 7T with AAC (I'm using Flutter to build the app). Using an AMR WB format works fine, though. Also all the AAC formats work fine when given to Google Gemini Flash/Pro models

Notice how the completion_tokens are 256; the model wasn't actually done, but got cut off because ma

Similar Threads

Similar Threads

Similar Threads