Work mostly.

C

If ur spending over 3k a year on AI you should probably consider setting up your own local one that is private. I use AI all day and night and haven't spent more than $30 in last 2 years

CCarlos Alberto If ur spending over 3k a year on AI you should probably consider setting up your...

D

daveOP•7/11/25, 2:55 PM

Getting a local instance of Claude Sonnet 4 would be several million.

C

Carlos Alberto•7/11/25, 6:06 PM

Everything is a wrapper bro. All you need is a unified multimodal api, secure AI gateway, a few MCPs, some rules, an OS ui and you're good to go. Total bill shouldn't cost more than a few hundred bucks. You could deploy at zero cost with a little engineering.

D

dan—1106•7/11/25, 6:39 PM

Hello, I'm looking to attach pdf/xlsx/csv files to a request I'm sending to Google AI Studio via AI Gateway. Is that possible? If it is, would someone mind sharing a basic example? Thanks in advance for your help

Ddan—1106 Hello, I'm looking to attach pdf/xlsx/csv files to a request I'm sending to Goog...

D

dan—1106•7/11/25, 7:05 PM

for folks who come across this later, I attached files to my messages like this:

  const url = await gateway.getUrl();
  const client = new OpenAI({
    apiKey: apiKey, 
    baseURL: `${url}compat`,
  });
  for (const file of files) {
    const base64Content = Buffer.from(file.content).toString("base64");
  const messageContent: Array<any> = [
    {
      type: "text",
      text: fullPrompt,
    },
  ];
    messageContent.push({
      type: "image_url", // Use "image_url" for all files.
      image_url: {
        url: `data:${file.contentType};base64,${base64Content}`,
      },
    });
  }
  const completionPromise = client.chat.completions.create({
    model: model,
    messages: [
      {
        role: "user",
        content: messageContent,
      },
    ],
    response_format: zodResponseFormat(responseSchema, "query_response"),
  });

  const url = await gateway.getUrl();
  const client = new OpenAI({
    apiKey: apiKey, 
    baseURL: `${url}compat`,
  });
  for (const file of files) {
    const base64Content = Buffer.from(file.content).toString("base64");
  const messageContent: Array<any> = [
    {
      type: "text",
      text: fullPrompt,
    },
  ];
    messageContent.push({
      type: "image_url", // Use "image_url" for all files.
      image_url: {
        url: `data:${file.contentType};base64,${base64Content}`,
      },
    });
  }
  const completionPromise = client.chat.completions.create({
    model: model,
    messages: [
      {
        role: "user",
        content: messageContent,
      },
    ],
    response_format: zodResponseFormat(responseSchema, "query_response"),
  });

  const url = await gateway.getUrl();
  const client = new OpenAI({
    apiKey: apiKey, 
    baseURL: `${url}compat`,
  });
  for (const file of files) {
    const base64Content = Buffer.from(file.content).toString("base64");
  const messageContent: Array<any> = [
    {
      type: "text",
      text: fullPrompt,
    },
  ];
    messageContent.push({
      type: "image_url", // Use "image_url" for all files.
      image_url: {
        url: `data:${file.contentType};base64,${base64Content}`,
      },
    });
  }
  const completionPromise = client.chat.completions.create({
    model: model,
    messages: [
      {
        role: "user",
        content: messageContent,
      },
    ],
    response_format: zodResponseFormat(responseSchema, "query_response"),
  });

  const url = await gateway.getUrl();
  const client = new OpenAI({
    apiKey: apiKey, 
    baseURL: `${url}compat`,
  });
  for (const file of files) {
    const base64Content = Buffer.from(file.content).toString("base64");
  const messageContent: Array<any> = [
    {
      type: "text",
      text: fullPrompt,
    },
  ];
    messageContent.push({
      type: "image_url", // Use "image_url" for all files.
      image_url: {
        url: `data:${file.contentType};base64,${base64Content}`,
      },
    });
  }
  const completionPromise = client.chat.completions.create({
    model: model,
    messages: [
      {
        role: "user",
        content: messageContent,
      },
    ],
    response_format: zodResponseFormat(responseSchema, "query_response"),
  });

Ddan—1106 Hello, I'm looking to attach pdf/xlsx/csv files to a request I'm sending to Goog...

C

Carlos Alberto•7/11/25, 7:38 PM

Have you tried Google Sheets Appscript? It's free, serverless, secure and has seamless integration with Google's stack. Cloudflare and Google Chrome both run on V8 edge native. So you're good to go.

CCarlos Alberto Have you tried Google Sheets Appscript? It's free, serverless, secure and has se...

I

Isaac McFadyen•7/11/25, 7:47 PM

Not sure how that's related? They were asking specifically about using AI Gateway + Google AI Studio, not Sheets, and even if they used Appscript they would still need to know how to attach files to requests going through AI Gateway.

IIsaac McFadyen Not sure how that's related? They were asking specifically about using AI Gatewa...

C

Carlos Alberto•7/11/25, 7:56 PM

Appscript solves - cold starts, serverless, costs, login, cybersecurity, storage, speed and tech chaining. All you need is a script. Vanilla javascript can automate anything. Cloudflare worker is an excellent proxy. Gemini 2.5 flash can make an optimized script for you within 3-4 iterations if you give clear instructions.

CCarlos Alberto Appscript solves - cold starts, serverless, costs, login, cybersecurity, storage...

I

Isaac McFadyen•7/11/25, 8:12 PM

They didn't ask about Appscript, cold starts, costs, logins, etc. They asked a specific question about a specific task with a Cloudflare product (AI Gateway), so responding with unrelated commentary is unproductive.

IIsaac McFadyen They didn't ask about Appscript, cold starts, costs, logins, etc. They asked a s...

C

Carlos Alberto•7/11/25, 8:13 PM

Then what's your solution Einstein?

CCarlos Alberto Then what's your solution Einstein?

I

Isaac McFadyen•7/11/25, 8:13 PM

I don't have one because I don't know the answer to their question, but telling them to use Appscript is not the answer.

IIsaac McFadyen I don't have one because I don't know the answer to their question, but telling ...

C

Carlos Alberto•7/11/25, 8:15 PM

Why not?

CCarlos Alberto Why not?

I

Isaac McFadyen•7/11/25, 8:17 PM

Because... it's completely unrelated? It's not the Cloudflare product they asked about and it's not the answer to their (very specific) question.

IIsaac McFadyen Because... it's completely unrelated? It's not the Cloudflare product they asked...

C

Carlos Alberto•7/11/25, 8:18 PM

Is that a fact?

Ddan—1106 for folks who come across this later, I attached files to my messages like this:...

V

Victor•7/11/25, 8:19 PM

Just FYI, there's an attachment limit of 20MB with this format as documented in the Files API. Beyond that (or as an alternative to reuse the same upload for multiple prompts), they recommend using their files API and using the reference (from the returned metadata) to it as the new

image_url

image_url

image_url

image_url in the prompt. Full File API Endpoint documentation

V

Vk•7/26/25, 11:15 PM

Question on this https://developers.cloudflare.com/ai-gateway/configuration/authentication/ > Does this create a token scoped to the specific gateway only ? and can we generate key programmatically?

Cloudflare Docs

Authentication

Add security by requiring a valid authorization token for each request.

VVk Question on this https://developers.cloudflare.com/ai-gateway/configuration/auth...

V

Vk•7/28/25, 6:10 PM

Other issue i had was even from my account, when i tried to create a token...it was not working...

T

Tristan•7/30/25, 9:59 AM

Hello, we've been using GatewayAI since almost day one, but it's still sad to see that you don't put prices for

openAI/dall-e-3

openAI/dall-e-3

openAI/dall-e-3

openAI/dall-e-3 image generation.

Our apps uses a lot of that and the pricing you're displaying is wrong since you don't take that into consideration.

One easy fix and accurate would be to map prices with the quality and resolution asked since it's known there:

S

Shados•8/1/25, 6:30 PM

Does CF AI Gateway support enteprise log push? Reading the history in this channel and the few convos I can see are unclear (not the documented Worker Log Push). We use it for all our Worker stuff without issue, but having trouble getting it to work with CF AI Gateway.

S

Shados•8/1/25, 6:44 PM

Its clearly there, but no data goes through for us and it doesn't seem to be anywhere in the documentation, as if its not supposed to exist.

W

wellroundedtable•8/1/25, 6:56 PM

Hey guys, I think I may have complicated the system by trying to manage my domain from multiple Cloudflare acounts. In one account my domains status is: active. Cloudflare sent an email to that email address warning me that I need to validate my domain, but when I click the box and approve the certificate I receive this error:

An error occurred while attempting to validate your domain. Please try again later or contact support for assistance.

Does this have anything to do with my being “connected” to the same domain with a different Cloudflare acounts associated with a different email address with the status as “invalid nameservers.”

B

Bash•8/5/25, 2:54 PM

AI gateway doesn't support transcription endpoints? I tried sending the below request through the gateway but it just gives this error: "500 Audio file processing failed". Looks like something to do with the audio file not getting sent properly? It works fine when sending it without AI Gateway

Request:

{
  "model": "gpt-4o-mini-transcribe",
  "response_format": "text",
  "file": {}
}

{
  "model": "gpt-4o-mini-transcribe",
  "response_format": "text",
  "file": {}
}

{
  "model": "gpt-4o-mini-transcribe",
  "response_format": "text",
  "file": {}
}

{
  "model": "gpt-4o-mini-transcribe",
  "response_format": "text",
  "file": {}
}

Response:

{
  "error": {
    "message": "Audio file processing failed",
    "type": "server_error",
    "param": null,
    "code": null
  }
}

{
  "error": {
    "message": "Audio file processing failed",
    "type": "server_error",
    "param": null,
    "code": null
  }
}

{
  "error": {
    "message": "Audio file processing failed",
    "type": "server_error",
    "param": null,
    "code": null
  }
}

{
  "error": {
    "message": "Audio file processing failed",
    "type": "server_error",
    "param": null,
    "code": null
  }
}

S

Sam•8/6/25, 5:49 AM

Is it possible to help me with getting cloudflare AI gateway + azure + vercel ai sdk running? (vercel ai sdk uses the /openai/v1/chat/completions approach rather than the deployment name like the azure provider cloudflare ai gateway uses.

S

Sam•8/6/25, 5:50 AM

Have tried a bunch of combinations and not managed to get anything working! (it works fine with all my other providers)

S

saeedesmaili•8/7/25, 11:36 AM

Is it possible to set

thinking_budget

thinking_budget

thinking_budget

thinking_budget when using

google-ai-studio

google-ai-studio

google-ai-studio

google-ai-studio models on ai gateway? Google has thinking enabled by default for models like

gemini-flash-2.5

gemini-flash-2.5

gemini-flash-2.5

gemini-flash-2.5, and to request a response without thinking we should set

thinking_budget

thinking_budget

thinking_budget

thinking_budget to 0, but I can't figure out how to do this when using cloudflare ai gateway.

V

vcd•8/12/25, 8:51 AM

Hello everyone, I encountered some issues while using ai-gateway.

I usually use OPTIONS requests to check if the interface is available, but when I request openrouter through the gateway, I get a 500 error internally in Cloudflare, like this

curl --location --request OPTIONS ‘https://your-gateway/openrouter/v1/models’

curl --location --request OPTIONS ‘https://your-gateway/openrouter/v1/models’

curl --location --request OPTIONS ‘https://your-gateway/openrouter/v1/models’

curl --location --request OPTIONS ‘https://your-gateway/openrouter/v1/models’

which would return

< HTTP/2 500
< date: Tue, 12 Aug 2025 08:49:47 GMT
< content-type: application/json
< content-length: 101
< server: cloudflare
< nel: {"report_to":"cf-nel","success_fraction":0.0,"max_age":604800}
< vary: Accept-Encoding
< cf-cache-status: DYNAMIC
< strict-transport-security: max-age=15552000; includeSubDomains; preload
< x-content-type-options: nosniff
< cf-ray: 96deb8af99b71d6d-SIN
< alt-svc: h3=":443"; ma=86400

{"success":false,"result":[],"messages":[],"error":[{"code":2002,"message":"Internal server error"}]}

< HTTP/2 500
< date: Tue, 12 Aug 2025 08:49:47 GMT
< content-type: application/json
< content-length: 101
< server: cloudflare
< nel: {"report_to":"cf-nel","success_fraction":0.0,"max_age":604800}
< vary: Accept-Encoding
< cf-cache-status: DYNAMIC
< strict-transport-security: max-age=15552000; includeSubDomains; preload
< x-content-type-options: nosniff
< cf-ray: 96deb8af99b71d6d-SIN
< alt-svc: h3=":443"; ma=86400

{"success":false,"result":[],"messages":[],"error":[{"code":2002,"message":"Internal server error"}]}

< HTTP/2 500
< date: Tue, 12 Aug 2025 08:49:47 GMT
< content-type: application/json
< content-length: 101
< server: cloudflare
< nel: {"report_to":"cf-nel","success_fraction":0.0,"max_age":604800}
< vary: Accept-Encoding
< cf-cache-status: DYNAMIC
< strict-transport-security: max-age=15552000; includeSubDomains; preload
< x-content-type-options: nosniff
< cf-ray: 96deb8af99b71d6d-SIN
< alt-svc: h3=":443"; ma=86400

{"success":false,"result":[],"messages":[],"error":[{"code":2002,"message":"Internal server error"}]}

< HTTP/2 500
< date: Tue, 12 Aug 2025 08:49:47 GMT
< content-type: application/json
< content-length: 101
< server: cloudflare
< nel: {"report_to":"cf-nel","success_fraction":0.0,"max_age":604800}
< vary: Accept-Encoding
< cf-cache-status: DYNAMIC
< strict-transport-security: max-age=15552000; includeSubDomains; preload
< x-content-type-options: nosniff
< cf-ray: 96deb8af99b71d6d-SIN
< alt-svc: h3=":443"; ma=86400

{"success":false,"result":[],"messages":[],"error":[{"code":2002,"message":"Internal server error"}]}

I'm not sure why this is happening, as other endpoints are functioning normally.

Original message was deleted

I

Isaac McFadyen•8/14/25, 3:13 AM

?crossposting also this is a better fit for Workers AI, the NSFW detector isn't related to AI Gateway.

S

SuperHelpflare•8/14/25, 3:13 AM

Please do not post your question in multiple channels/post it multiple times per the rules at #

welcome-and-rules. It creates confusion for people trying to help you and doesn't get your issue or question solved any faster.

IIsaac McFadyen ?crossposting also this is a better fit for Workers AI, the NSFW detector isn't ...

N

Nhat Bui•8/14/25, 3:15 AM

thanks, I am deleting

V

Victor•8/14/25, 7:06 PM

Trying to check logs for an ai gateway and getting HTTP 500 (

7000

7000)

Error: The requested Durable Object is temporarily disabled, please contact us for details

Error: The requested Durable Object is temporarily disabled, please contact us for details

Error: The requested Durable Object is temporarily disabled, please contact us for details

Error: The requested Durable Object is temporarily disabled, please contact us for details

V

Victor•8/15/25, 6:31 PM

I'm getting 404

7002: Not Found

7002: Not Found

7002: Not Found

7002: Not Found on

Patch Gateway Log

Patch Gateway Log

Patch Gateway Log

Patch Gateway Log. But going into the ai gateway dashboard and I can find the exact log from the url

M

mrwind•8/20/25, 1:54 AM

hi can i use AI gateway but route request from hongkong to another regions ? I got this error "message": "User location is not supported for the API use.", "status": "FAILED_PRECONDITION"

J

John Reyes•8/20/25, 3:03 AM

https://athleteoftheyear.org/2025/luke-72b9

Vote for Luke to be featured in a 3BRAND ad in Sports Illustrated a...

8 Year Old Amazing Baseball/soccer Player Who Works Hard Day In And Day Out. Started At Age 4 And Currently Plays Up In 9u And 11u Teams.

J

John Reyes•8/20/25, 3:04 AM

Vote for this kid

Mmrwind hi can i use AI gateway but route request from hongkong to another regions ? ...

V

vcd•8/20/25, 6:57 AM

AIGateway will default to inserting Cf-Country into the request, which cannot be changed.

When you request a provider such as OpenAI, it will be filtered according to the provider's service policy.

For similar providers, I recommend using a gateway service such as OpenRouter or adding an additional layer of routing (to SG maybe).

K

Kevin•8/20/25, 10:00 AM

In case anyone is wondering since its not written anywhere, gateway does support responses enpoint using workers-ai provider for gpt-oss models. I was just testing that

K

Kevin•8/20/25, 5:01 PM

The cost feature is automatic or do I have to send it? Because the cost is still 0 while using workers-ai provider.

Y

yinxingmaiming6409•8/21/25, 2:11 AM

How can AI be used in Cherry Studio? It seems impossible.

Yyinxingmaiming6409 How can AI be used in Cherry Studio? It seems impossible.

I

Isaac McFadyen•8/21/25, 2:37 AM

?crossposting Please don't post in multiple channels.

S

SuperHelpflare•8/21/25, 2:37 AM

Please do not post your question in multiple channels/post it multiple times per the rules at #

welcome-and-rules. It creates confusion for people trying to help you and doesn't get your issue or question solved any faster.

T

Tristan•8/21/25, 7:46 AM

hey, can someone from cloudflare can take a look at my message, it slipped through: ai-gateway

B

ben_makes_stuff•8/25/25, 2:57 AM

Any plans to make the OpenAI-compatible endpoint work with Amazon Bedrock? They're very lazy about their implementation and recommend customers use an AWS lambda function with custom code if using the OpenAI SDK, they don't provide an OpenAI-compatible endpoint like Google does

D

daveOP•8/26/25, 6:51 PM

Looks like pricing for Anthropic models with caching has been fixed?

H

hurrytospring•8/28/25, 5:34 AM

We are a startup tech company considering using Cloudflare AI Gateway. Before proceeding, we have the following questions:
It seems that there is no support for the DeepSeek V3 or Qwen 3 models. Is there any other way to access them? They are really cost - effective.
Is the AI Gateway ready for production use? What are the limits of queries per second (QPS) and tokens per minute (TPM)?
Compared to native providers like Vertex/ Bedrock, when making requests from Google Cloud Platform (GCP) or Amazon Web Services (AWS), how does the latency or token speed differ? By the way, how does the price compare?

Similar Threads

Similar Threads

Similar Threads