What would be amazing in gateway would be some sort of user analytics, openai and other proviers all

Ccosbgn What would be amazing in gateway would be some sort of user analytics, openai an...

J

You can do this by passing in metadata. Here is the Typescript code we use

export function buildAIGatewayHeaders(
  env: SharedHonoEnv,
  headers?: LLMHeaders
): Record<string, string> {
  const metadata: Record<string, string> = {};

  // Allowlist: only include specific headers we want to pass to AIGateway
  if (headers?.userToken) {
    metadata.userToken = headers.userToken;
  }

  if (headers?.accountToken) {
    metadata.accountToken = headers.accountToken;
  }

  if (headers?.requestId) {
    metadata.requestId = headers.requestId;
  }

  const aigHeaders = {
    "cf-aig-authorization": `Bearer ${env.CLOUDFLARE_AI_GATEWAY_API_KEY}`,
    "cf-aig-metadata": JSON.stringify(metadata),
  };

  return aigHeaders;
}

export function buildAIGatewayHeaders(
  env: SharedHonoEnv,
  headers?: LLMHeaders
): Record<string, string> {
  const metadata: Record<string, string> = {};

  // Allowlist: only include specific headers we want to pass to AIGateway
  if (headers?.userToken) {
    metadata.userToken = headers.userToken;
  }

  if (headers?.accountToken) {
    metadata.accountToken = headers.accountToken;
  }

  if (headers?.requestId) {
    metadata.requestId = headers.requestId;
  }

  const aigHeaders = {
    "cf-aig-authorization": `Bearer ${env.CLOUDFLARE_AI_GATEWAY_API_KEY}`,
    "cf-aig-metadata": JSON.stringify(metadata),
  };

  return aigHeaders;
}

export function buildAIGatewayHeaders(
  env: SharedHonoEnv,
  headers?: LLMHeaders
): Record<string, string> {
  const metadata: Record<string, string> = {};

  // Allowlist: only include specific headers we want to pass to AIGateway
  if (headers?.userToken) {
    metadata.userToken = headers.userToken;
  }

  if (headers?.accountToken) {
    metadata.accountToken = headers.accountToken;
  }

  if (headers?.requestId) {
    metadata.requestId = headers.requestId;
  }

  const aigHeaders = {
    "cf-aig-authorization": `Bearer ${env.CLOUDFLARE_AI_GATEWAY_API_KEY}`,
    "cf-aig-metadata": JSON.stringify(metadata),
  };

  return aigHeaders;
}

export function buildAIGatewayHeaders(
  env: SharedHonoEnv,
  headers?: LLMHeaders
): Record<string, string> {
  const metadata: Record<string, string> = {};

  // Allowlist: only include specific headers we want to pass to AIGateway
  if (headers?.userToken) {
    metadata.userToken = headers.userToken;
  }

  if (headers?.accountToken) {
    metadata.accountToken = headers.accountToken;
  }

  if (headers?.requestId) {
    metadata.requestId = headers.requestId;
  }

  const aigHeaders = {
    "cf-aig-authorization": `Bearer ${env.CLOUDFLARE_AI_GATEWAY_API_KEY}`,
    "cf-aig-metadata": JSON.stringify(metadata),
  };

  return aigHeaders;
}

J

Jeremy Kreutzbender•11/13/25, 4:52 PM

Then you can filter the data in the dashboard

C

cosbgnOP•11/14/25, 8:09 AM

Nice

C

cosbgnOP•11/14/25, 8:09 AM

thanks

BBryan Chen I want to use AI gateway dynamic routing. However, it seems only support the bas...

B

Bryan Chen•11/17/25, 9:21 PM

B

Bryan Chen•11/17/25, 9:21 PM

any help plz?

N

nikiv.dev•11/19/25, 4:41 PM

CLOUDFLARE_GATEWAY_HOST=https://gateway.ai.cloudflare.com
CLOUDFLARE_GATEWAY_ENDPOINT=/v1/e1a1737083ffd849ad2638b7e6069dec/lin/compat
CLOUDFLARE_GATEWAY_API_KEY=
CLOUDFLARE_GATEWAY_MODEL=google/gemini-2.0-flash

CLOUDFLARE_GATEWAY_HOST=https://gateway.ai.cloudflare.com
CLOUDFLARE_GATEWAY_ENDPOINT=/v1/e1a1737083ffd849ad2638b7e6069dec/lin/compat
CLOUDFLARE_GATEWAY_API_KEY=
CLOUDFLARE_GATEWAY_MODEL=google/gemini-2.0-flash

CLOUDFLARE_GATEWAY_HOST=https://gateway.ai.cloudflare.com
CLOUDFLARE_GATEWAY_ENDPOINT=/v1/e1a1737083ffd849ad2638b7e6069dec/lin/compat
CLOUDFLARE_GATEWAY_API_KEY=
CLOUDFLARE_GATEWAY_MODEL=google/gemini-2.0-flash

CLOUDFLARE_GATEWAY_HOST=https://gateway.ai.cloudflare.com
CLOUDFLARE_GATEWAY_ENDPOINT=/v1/e1a1737083ffd849ad2638b7e6069dec/lin/compat
CLOUDFLARE_GATEWAY_API_KEY=
CLOUDFLARE_GATEWAY_MODEL=google/gemini-2.0-flash

N

nikiv.dev•11/19/25, 4:41 PM

i need to get these values apparently

N

nikiv.dev•11/19/25, 4:41 PM

N

nikiv.dev•11/19/25, 4:41 PM

but i don't get where

N

nikiv.dev•11/19/25, 4:41 PM

no envs here

N

nikiv.dev•11/19/25, 4:41 PM

i do have google ai studio there

Nnikiv.dev ``` CLOUDFLARE_GATEWAY_HOST=https://gateway.ai.cloudflare.com CLOUDFLARE_GATEWAY...

I

Isaac McFadyen•11/19/25, 4:57 PM

API Key needs to be generated from https://dash.cloudflare.com/?to=/:account/api-tokens and needs to have the AI Gateway permission. Gateway Endpoint looks correct already, assuming that's your proper Account ID in there.

S

Shados•11/20/25, 8:26 PM

Do CF worker AI models have rate limits for tokens? On the limts page, I can see RPM limits but not TPMs (beyond the context window of the model)

N

Nils•11/22/25, 3:36 PM

Scribe v2 best model and not availiable?

N

nwp•11/23/25, 10:23 AM

It is my understanding that if we enable billing we should be able to setup an authenticated gateway and then call any LLM provider supported by AI Gateway without providing the provider’s API key (since CF is handing the billing). However, if I issue a curl and do not provide the underlying provider’s API key, I get an error stating that I must provide it (in addition to the AI Gateway’s token which I generated in CF with the run permission). This makes no sense to me. Isn’t the whole point to be able to provide ONE key, access any provider and pay one bill to CF for all inferencing. This is the way the Vercel AI Gateway works but I want to host fully on CF.

C

cosbgnOP•11/24/25, 10:54 AM

Anyone managed to connect dynamic models with

ai-sdk

ai-sdk

ai-sdk

ai-sdk? this fails with a vague

internal server error

internal server error

internal server error

internal server error

C

cosbgnOP•11/24/25, 11:22 AM

This works if anyone searches this:

    const openai = createOpenAICompatible({
        name: 'cloudflare-gateway',
        headers: { "cf-aig-authorization": `Bearer ${process.env.CLOUDFLARE_AI_TOKEN}` },
        baseURL:`https://gateway.ai.cloudflare.com/v1/${process.env.CLOUDFLARE_ACCOUNT_ID}/${process.env.CLOUDFLARE_GATEWAY_NAME}/compat`,
        includeUsage: true,
        supportsStructuredOutputs: true
    });

    const openai = createOpenAICompatible({
        name: 'cloudflare-gateway',
        headers: { "cf-aig-authorization": `Bearer ${process.env.CLOUDFLARE_AI_TOKEN}` },
        baseURL:`https://gateway.ai.cloudflare.com/v1/${process.env.CLOUDFLARE_ACCOUNT_ID}/${process.env.CLOUDFLARE_GATEWAY_NAME}/compat`,
        includeUsage: true,
        supportsStructuredOutputs: true
    });

    const openai = createOpenAICompatible({
        name: 'cloudflare-gateway',
        headers: { "cf-aig-authorization": `Bearer ${process.env.CLOUDFLARE_AI_TOKEN}` },
        baseURL:`https://gateway.ai.cloudflare.com/v1/${process.env.CLOUDFLARE_ACCOUNT_ID}/${process.env.CLOUDFLARE_GATEWAY_NAME}/compat`,
        includeUsage: true,
        supportsStructuredOutputs: true
    });

    const openai = createOpenAICompatible({
        name: 'cloudflare-gateway',
        headers: { "cf-aig-authorization": `Bearer ${process.env.CLOUDFLARE_AI_TOKEN}` },
        baseURL:`https://gateway.ai.cloudflare.com/v1/${process.env.CLOUDFLARE_ACCOUNT_ID}/${process.env.CLOUDFLARE_GATEWAY_NAME}/compat`,
        includeUsage: true,
        supportsStructuredOutputs: true
    });

D

Dddduuu•11/24/25, 6:45 PM

hey there, what's the trick to get token count and costs on the UI? I've tried sending my own

cf-aig-custom-cost

cf-aig-custom-cost

cf-aig-custom-cost

cf-aig-custom-cost to no avail

D

Dddduuu•11/24/25, 6:49 PM

P.S if someone is "stuck" with Boto3 for Amazon Bedrock, it's doable https://gist.github.com/DDuarte/6bd7e3851e6519c988037f883f80eeb1

A

amsraman•11/24/25, 8:43 PM

I'm trying to use Claude 4-5 Sonnet on Azure Foundry through the AI Gateway -- is this platform currently supported? I'm only seeing "Azure OpenAI" as a provider option on the page (which, as I understand, is limited only to a select set of OpenAI models).

L

LemmoTresto•11/25/25, 1:28 PM

Is it known that AI Gateway with Unified Billing (Beta) doesn’t seem to work with OpenAI when using the Vercel AI SDK together with Cloudflare’s ai-gateway-provider package?

In my testing:
• OpenAI → fails entirely through Unified Billing
• Google Generative AI → the non-streaming functions (generateText, generateObject) work, but the streaming variants do not
• Anthropic → both streaming and non-streaming work as expected

This seems odd, since the documentation states that Unified Billing supports all of these providers. Is this a known limitation or an issue on Cloudflare’s side?

I know it’s still beta but just want to know.

LLemmoTresto Is it known that AI Gateway with Unified Billing (Beta) doesn’t seem to work wit...

N

nwp•11/25/25, 4:30 PM

I hope you get an answer to this because I’m struggling with the same thing.

L

LemmoTresto•11/25/25, 9:00 PM

Hoping on an answer from an employee, they might know more

Ccosbgn This works if anyone searches this: ```js const openai = createOpenAICompa...

N

nwp•11/26/25, 2:28 PM

Should be able to specify ‘openai/gpt-5’ or ‘groq/gpt-oss-120b’ as the model and it should work, but it doesn’t.

L

LemmoTresto•11/26/25, 5:50 PM

I use the vercel ai sdk with a provider registry and do it like that instead. You can specify your provider/model that way.

LLemmoTresto Is it known that AI Gateway with Unified Billing (Beta) doesn’t seem to work wit...

L

LemmoTresto•11/26/25, 5:50 PM

Still hoping for clarification on this

V

Victor•11/27/25, 5:15 AM

Is there an progress on supporting

v1

v1

v1

v1 and

v1-preview

v1-preview

v1-preview

v1-preview data plane API version (in azure) for ai gateway? Currently it breaks - unable to find resource (I assume url changes)

V

Victor•11/27/25, 5:16 AM

v1

v1

v1

v1 is the new GA version for a while now and the azure adapter in cercel ai sdk now defaults to it as well, breaking any usage relying on defaults

N

nwp•11/27/25, 6:42 AM

I’m pretty close to giving up on Cloudflare and just paying $20 to Vercel.

M

Maxz•11/27/25, 1:32 PM

is cloudflare ai gateway down?
Why can I call some models but not others?
do I need to top up more ?

M

Maxz•11/27/25, 1:33 PM

{
"code": "Some resource has been exhausted",
"error": "Your team 23361c02-xxxx has either used all available credits or reached its monthly spending limit. To continue making API requests, please purchase more credits or raise your spending limit."
}

what is this team concept ? I don't have team.

W

watershed•11/30/25, 6:18 AM

*

Subject: Bug Report: Google Gemini File Upload Size Mismatch (via SDK Monkey Patch)

Description:
I am reporting a critical issue with Google Gemini (AI Studio) file uploads when routed through Cloudflare AI Gateway.

I am using the official
google-genai
google-genai
google-genai
google-genai Python SDK. Since the SDK's resumable upload protocol automatically attempts to connect directly to
generativelanguage.googleapis.com
generativelanguage.googleapis.com
generativelanguage.googleapis.com
generativelanguage.googleapis.com for the data transfer phase (Step 2), I applied a monkey patch to the SDK to intercept the

upload_url

upload_url

upload_url

upload_url and rewrite the hostname to my Cloudflare Gateway endpoint.

The Issue:
While the initial handshake succeeds, the actual file data transfer fails when routed through the Gateway. Google returns a
400 Bad Request
400 Bad Request
400 Bad Request
400 Bad Request indicating that the data received is significantly larger (almost double) than the expected file size.

It seems the Gateway is mishandling the
Transfer-Encoding: chunked
Transfer-Encoding: chunked
Transfer-Encoding: chunked
Transfer-Encoding: chunked stream sent by the Python
httpx
httpx
httpx
httpx client, possibly causing data duplication or incorrect packet retries.

Error Log:
{ "code": 400, "message": "Can not finalize upload. Current size is 10085593. Expected final size is 5556955.", "status": "Bad Request" }
{ "code": 400, "message": "Can not finalize upload. Current size is 10085593. Expected final size is 5556955.", "status": "Bad Request" }
{ "code": 400, "message": "Can not finalize upload. Current size is 10085593. Expected final size is 5556955.", "status": "Bad Request" }
{ "code": 400, "message": "Can not finalize upload. Current size is 10085593. Expected final size is 5556955.", "status": "Bad Request" }

(Note: The
Current size
Current size
Current size
Current size ~10MB is nearly double the
Expected
Expected
Expected
Expected ~5.5MB.)

Reproduction Details:
SDK: Python
google-genai
google-genai
google-genai
google-genai (using
httpx
httpx
httpx
httpx).
Method: Monkey Patch applied to
client._api_client.upload_file
client._api_client.upload_file
client._api_client.upload_file
client._api_client.upload_file to replace
googleapis.com
googleapis.com
googleapis.com
googleapis.com with the Cloudflare Gateway URL.
Behavior: The SDK streams the file to Cloudflare -> Cloudflare forwards to Google -> Google rejects it due to size mismatch.

Reference Trace (CF-Ray):
9a6803f82f942a86-LAX
9a6803f82f942a86-LAX
9a6803f82f942a86-LAX
9a6803f82f942a86-LAX

Could the team please investigate how the Gateway proxies chunked upload streams for the Google provider?

*

R

R•12/2/25, 6:53 AM

hello, im looking to set up logpush for cloudflare ai gateway to datadog following this guide: https://developers.cloudflare.com/ai-gateway/observability/logging/logpush/.

is there a way to send these logs without encryption? it seems like datadog does not offer a way to decrypt them, and that would mean that the logpush job that i've created for these logs to be sent to datadog would be useless since they can't be decrypted at the datadog level

Cloudflare Docs

Workers Logpush

AI Gateway allows you to securely export logs to an external storage location, where you can decrypt and process them.
You can toggle Workers Logpush on and off in the Cloudflare dashboard settings. This product is available on the Workers Paid plan. For pricing information, refer to Pricing.

L

LemmoTresto•12/2/25, 6:09 PM

Has anyone used openrouter successfully with BYOK?

L

LemmoTresto•12/2/25, 6:09 PM

Tells me it is missing authentication, using the vercel sdk, and the openrouter provider package.

LLaPh Although the output is set to be image-only, it's being treated as text generati...

M

Maxz•12/3/25, 8:58 AM

is the playground vide coded? so many bugs

M

Maxz•12/3/25, 8:59 AM

These unfinished pages are definitely damaging cf's brand.

Ssodepr I’ve seen several posts mentioning that Cloudflare AI Gateway routes requests to...

S

sarme•12/4/25, 9:39 AM

We're are getting the same issue. We have no server in Asia at all but all requests are getting redirected to one place which is restricted from open Ai without any control for placement from ourside.

{
"error": {
"code": "unsupported_country_region_territory",
"message": "Country, region, or territory not supported",
"param": null,
"type": "request_forbidden"
}
}

Has anyone found anyway to solve it?

MMaxz is cloudflare ai gateway down? Why can I call some models but not others? do I n...

S

sarme•12/4/25, 9:41 AM

Our Open AI requests are also redirected to one place which is restricted. I wonder if they are related.

Hharshil1712 forwarding this to the team.

S

sarme•12/4/25, 9:44 AM

This is happening again. Our error rate has jumped to 25%. Could you have a look again? @Kathy @harshil1712

What would be amazing in gateway would be some sort of user analytics, openai and other proviers all

Similar Threads

Similar Threads

Similar Threads