Does the universal endpoint support tools? - Cloudflare Developers

© 2026 Hedgehog Software, LLC

More

Communities Docs About Terms Privacy

spongebhav

Sspongebhav I didn’t fully understand your question. By tools do you mean MCPs? or if we can...

Marino

M

MarinoOP•6/14/25, 5:36 PM

I mean tools as in function calling, I couldn't find anything in the docs.

Marino

MMarino Does the universal endpoint support tools?

U.Senthil Kumar | Contributor

U

U.Senthil Kumar | Contributor•6/15/25, 7:13 AM

Yes, the Universal Endpoint supports tools by allowing multi-provider payloads with specific configurations per message. It also handles retries and fallback logic, making tool use more flexible across providers.

U.Senthil Kumar | Contributor

UU.Senthil Kumar | Contributor Yes, the Universal Endpoint supports tools by allowing multi-provider payloads w...

Marino

M

MarinoOP•6/15/25, 2:59 PM

Thank you.

Bryan Chen

B

Bryan Chen•6/17/25, 8:03 AM

I disabled gateway auth and that got it working

Bryan Chen

B

Bryan Chen•6/17/25, 8:03 AM

zero responses from CF

newqueue

N

newqueue•6/17/25, 9:00 AM

# seems google-ai-studio streaming api not work, anybody know how to fix it?
curl "https://gateway.ai.cloudflare.com/v1/7{account_id}/{gateway_id}/google-ai-studio/v1beta/models/gemini-2.5-flash-preview-05-20:streamGenerateContent?alt=sse" \
           --header 'content-type: application/json' \
           --header 'x-goog-api-key: '(pass GEMINI_API_KEY) \
           --data '{
            "contents": [
                {
                  "role":"user",
                  "parts": [
                    {"text":"What is Cloudflare?"}
                  ]
                }
              ]
            }'

# seems google-ai-studio streaming api not work, anybody know how to fix it?
curl "https://gateway.ai.cloudflare.com/v1/7{account_id}/{gateway_id}/google-ai-studio/v1beta/models/gemini-2.5-flash-preview-05-20:streamGenerateContent?alt=sse" \
           --header 'content-type: application/json' \
           --header 'x-goog-api-key: '(pass GEMINI_API_KEY) \
           --data '{
            "contents": [
                {
                  "role":"user",
                  "parts": [
                    {"text":"What is Cloudflare?"}
                  ]
                }
              ]
            }'

motin

Mmotin I just posted in the community forums about a regression about the universal end...

Jorel

J

Jorel•6/23/25, 8:14 AM

I was working with this using the Cloudflare AI Gateway provider from Vercel's AI SDK, but could NOT get it to work.

Sounds like it's related, even tho i haven't inspected the actual resulting traffic. My workaround was to

Not use the built-in gateway provider, instead adding the gateway url manually

Sending the cloudflare AI Gateway authentication as cf-aig-authorizationcf-aig-authorization header

createOpenAI({
baseURL: `https://gateway.ai.cloudflare.com/v1/${env.CLOUDFLARE_ACCOUNT_ID}/${customer.gatewayId}/openai`,
apiKey: env.OPENAI_API_KEY,
headers: {
 'cf-aig-authorization': env.CLOUDFLARE_API_KEY,
},
});

createOpenAI({
baseURL: `https://gateway.ai.cloudflare.com/v1/${env.CLOUDFLARE_ACCOUNT_ID}/${customer.gatewayId}/openai`,
apiKey: env.OPENAI_API_KEY,
headers: {
 'cf-aig-authorization': env.CLOUDFLARE_API_KEY,
},
});

AngusMa

A

AngusMa•6/23/25, 1:31 PM

I've heard that workers AI has OpenAI compatible endpoints, does it include v1/modelsv1/models endpoint or only contain /v1/chat/completions/v1/chat/completions and /v1/embeddings/v1/embeddings?

Oblomki

O

Oblomki•6/23/25, 5:38 PM

Does AI Gateway return any kind of info when using the Universal Endpoint to know which model was successfully used (if using multiple providers in the fallback request)?

Oblomki

OOblomki Does AI Gateway return any kind of info when using the Universal Endpoint to kno...

Kathy

K

Kathy•6/23/25, 10:30 PM

https://developers.cloudflare.com/ai-gateway/configuration/fallbacks/#response-headercf-aig-step

Cloudflare Docs

Specify model or provider fallbacks with your Universal endpoint to handle request failures and ensure reliability.

dave

D

dave•6/24/25, 4:35 PM

Anthropic Claude Sonnet 4 and Opus 4 pricing are still very wrong, they aren't taking into account cache related tokens at all.

Tait

T

Tait•6/24/25, 8:55 PM

I was trying to https://github.com/googleapis/js-genai with AI Gateway. Is that supported? My inital take after fighting with this for a while is that I should use the deprecated google library https://github.com/google-gemini/deprecated-generative-ai-js

Am I completely wrong? I hope so. I'm trying to use gemini to process short videos and I'd love to track my codst.

GitHub

GitHub - googleapis/js-genai: TypeScript/JavaScript SDK for Gemini ...

TypeScript/JavaScript SDK for Gemini and Vertex AI. - googleapis/js-genai

GitHub

GitHub - google-gemini/deprecated-generative-ai-js: This SDK is now...

This SDK is now deprecated, use the new unified Google GenAI SDK. - google-gemini/deprecated-generative-ai-js

piffie

P

piffie•6/25/25, 7:42 AM

Is there a better Frontend for the AI-gateway? where i can see maybe prompt versions or similar?

Tait

TTait I was trying to https://github.com/googleapis/js-genai with AI Gateway. Is that...

AngusMa

A

AngusMa•6/29/25, 3:22 AM

I think AI Gateway is based on REST API?

Shados

S

Shados•6/29/25, 5:17 AM

I'm using a gateway with a Worker AI binding (the "basic usage" in section 2 on https://developers.cloudflare.com/ai-gateway/integrations/worker-binding-methods/)

I don't get any error and my app works, but I don't see anything in the gateway's logs.

If I use the REST endpoint to my gateway to make the same request to the same model, then I see log entries. Is that a bug or am I doing something wrong?

If I use this.env.AI.gateway then gateway.run, then it works as I expected, but since the doc and the typescript type explicitely state the gateway feature should be supported directly, I found the behavior surprising.

Shados

S

Shados•6/29/25, 5:50 AM

Even then something seems off. Some features like input/output tokens and cost don't register when I go through the gateway.rungateway.run function inside workers.

So so far:

using a regular Worker AI binding with the gateway property: doesn't show up in logs at all
Getting the gateway by id from the binding and calling gateway.run: shows up in logs, no token/cost show up
Using REST api via curl: everything works as expected.

(it case it matters, im using the Worker AI models in this case)

Edit: Ok token/cost is not REST api vs gateway binding, its Streaming vs Non-Streaming.

So that only leaves the issue of: Why do I not get logs if I'm using the bindings without gateway.run? Is it because it only logs queries that go through the API and direct bindings bypass that? In which case what features do I actually get, since logs are kind of the big one?

A

ac•6/29/25, 7:12 PM

We are having issues where OpenAI requests are now getting blocked because they are originating from unsupported countries (via AI Gateway). This didn't start happening until this week for us, but it seems to be a new error as of the past few weeks (see https://community.cloudflare.com/t/cloudflare-worker-blocked-by-openai/804750

https://community.cloudflare.com/t/ai-gateway-routes-to-restricted-regions-causing-api-blocks/808571/6).

an anyone at Cloudflare comment on this?

Aac We are having issues where OpenAI requests are now getting blocked because they ...

harshil1712

H

harshil1712•6/30/25, 10:33 AM

forwarding this to the team.

harshil1712

Hharshil1712 forwarding this to the team.

A

ac•6/30/25, 10:37 AM

Thank you! This is a big issue for us.

jedi

J

jedi•6/30/25, 12:16 PM

hi guys

jedi

J

jedi•6/30/25, 12:16 PM

how can i apply temperature?

jedi

J

jedi•6/30/25, 12:16 PM

in the request via api?

V

Vk•7/1/25, 7:40 PM

Do you support custom domain for AI Gateway? Can we use AI gateway to invoke all the worker AI inference points? (Or are there exceptions)?

neil

N

neil•7/3/25, 2:04 AM

hey! currently seeing issues (not sdk - appears to be cf's backend issue) with Universal Endpoint's Authorization header forwarding FOR ALL PROVIDERS

only for Authenticated Gateways. disabling Authenticated Gateway fixes the issue.

_Example__
Request:

curl https://gateway.ai.cloudflare.com/v1/[account_id]/[gateway-id] \
  --header 'Content-Type: application/json' \
  --header 'cf-aig-authorization: Bearer [cf-aig-token]' \
  --data '[
    {
      "provider": "openai",
      "endpoint": "chat/completions",
      "headers": {
        "Authorization": "Bearer [openai_api_key]",
      },
      "query": {
        "model": "gpt-4o-mini",
        "messages": [
          {
            "role": "user",
            "content": "What is Cloudflare?"
          }
        ]
      }
    }
  ]'

curl https://gateway.ai.cloudflare.com/v1/[account_id]/[gateway-id] \
  --header 'Content-Type: application/json' \
  --header 'cf-aig-authorization: Bearer [cf-aig-token]' \
  --data '[
    {
      "provider": "openai",
      "endpoint": "chat/completions",
      "headers": {
        "Authorization": "Bearer [openai_api_key]",
      },
      "query": {
        "model": "gpt-4o-mini",
        "messages": [
          {
            "role": "user",
            "content": "What is Cloudflare?"
          }
        ]
      }
    }
  ]'

Response:

{
    "error": {
        "message": "You didn't provide an API key. You need to provide your API key in an Authorization header using Bearer auth (i.e. Authorization: Bearer YOUR_KEY), or as the password field (with blank username) if you're accessing the API from your browser and are prompted for a username and password. You can obtain an API key from https://platform.openai.com/account/api-keys.",
        "type": "invalid_request_error",
        "param": null,
        "code": null
    }
}

{
    "error": {
        "message": "You didn't provide an API key. You need to provide your API key in an Authorization header using Bearer auth (i.e. Authorization: Bearer YOUR_KEY), or as the password field (with blank username) if you're accessing the API from your browser and are prompted for a username and password. You can obtain an API key from https://platform.openai.com/account/api-keys.",
        "type": "invalid_request_error",
        "param": null,
        "code": null
    }
}

Have tried sending api key with initial request headers, in the body like above, and both. Issue is not just scoped to OpenAI's api - have also tested Vertex AI and issue persists. Anthropic does not have this issue since their api key is supplied in the x-api-keyx-api-key header.

ari

A

ari•7/3/25, 2:14 AM

We've been seeing something similar. Universal endpoint + Authenticated Gateway. We have OpenAI as primary and Anthropic as secondary, and OpenAI consistently fails with this same error message and then Anthropic succeeds. On one hand, it's a win for the cross-vendor fallback model.

ari

A

ari•7/3/25, 4:08 AM

In the process of trying to debug this, I came across conflicting documentation on where the authorizationauthorization should be stored. Is this out-of-date? https://developers.cloudflare.com/ai-gateway/universal/#:~:text=The%20payload%20is%20expecting%20an%20array%20of%20message%2C%20and%20each%20message%20is%20an%20object%20with%20the%20following%20parameters

neil

N

neil•7/3/25, 5:11 AM

seems like it - the worker gateway binding also doesn't have types for this prop

neil

N

neil•7/3/25, 5:12 AM

Screenshot_2025-07-02_at_10.12.23_PM.png

ari

A

ari•7/3/25, 6:47 AM

I did find one call that worked that I wasn't expecting: moving the OpenAI-specific authorization up to the top level, next to the cf-aig-authorizationcf-aig-authorization gateway-level setting. Perhaps this is header configuration hierarchy at work? https://developers.cloudflare.com/ai-gateway/universal/#header-configuration-hierarchy

Screenshot_2025-07-02_at_11.41.20_PM.png

neil

N

neil•7/3/25, 9:05 AM

hm i just tried putting it in the top level header - both with and without it being in the request body

neil

N

neil•7/3/25, 9:05 AM

didn't work for curl at least

neil

N

neil•7/3/25, 9:06 AM

either way, authorization should def be a request level header for universal endpoint

V

Vk•7/3/25, 1:51 PM

Hello folks: Trying to understand AI Gateway better. With the openAI compatible endpoint, does it support all the models and integrations using compatible endpoint or are there specific ones"

neil

N

neil•7/3/25, 8:21 PM

it’s basically a reverse proxy for rest endpoints (primarily nice for centralized logging). you can specifically request a url path with the endpoint body parameter for universal endpoint or just concat to the url path for provider specific ai gateway

neil

N

neil•7/3/25, 8:22 PM

so for example you can request openai’s /chat/completions as well as /responses with { model: “gpt-4.1” | “gpt-4o” } in the request body

Cappy Ishihara

C

Cappy Ishihara•7/4/25, 6:32 PM

currently trying to use the CF AI gateway with Zed to run tool calls, seems like it's failing for some reason to call any tools

dave

Ddave Anthropic Claude Sonnet 4 and Opus 4 pricing are still very wrong, they aren't t...

Carlos Alberto

C

Carlos Alberto•7/11/25, 11:12 AM

If you combine deepseek with just a few MCPs you will get a much more powerful model than Anthropic and at a fraction of the cost

Carlos Alberto

CCarlos Alberto If you combine deepseek with just a few MCPs you will get a much more powerful m...

dave

D

dave•7/11/25, 12:17 PM

I’m using Claude Max 20x so my “real” cost for tokens is fixed at $200/m, regardless of how many I use.

dave

Ddave I’m using Claude Max 20x so my “real” cost for tokens is fixed at $200/m, regard...

Carlos Alberto

C

Carlos Alberto•7/11/25, 2:28 PM

Ur spending $2400 a year to use AI ?

Carlos Alberto

CCarlos Alberto Ur spending $2400 a year to use AI ?

dave

D

dave•7/11/25, 2:29 PM

Far more than that.

dave

Ddave Far more than that.

Carlos Alberto

C

Carlos Alberto•7/11/25, 2:31 PM

What is ur use case?

Carlos Alberto

CCarlos Alberto What is ur use case?

dave

D

dave•7/11/25, 2:35 PM

Work mostly.

dave

Ddave Work mostly.

Carlos Alberto

C

Carlos Alberto•7/11/25, 2:41 PM

If ur spending over 3k a year on AI you should probably consider setting up your own local one that is private. I use AI all day and night and haven't spent more than $30 in last 2 years

curl https://gateway.ai.cloudflare.com/v1/[account_id]/[gateway-id] \
  --header 'Content-Type: application/json' \
  --header 'cf-aig-authorization: Bearer [cf-aig-token]' \
  --data '[
    {
      "provider": "openai",
      "endpoint": "chat/completions",
      "headers": {
        "Authorization": "Bearer [openai_api_key]",
      },
      "query": {
        "model": "gpt-4o-mini",
        "messages": [
          {
            "role": "user",
            "content": "What is Cloudflare?"
          }
        ]
      }
    }
  ]'

curl https://gateway.ai.cloudflare.com/v1/[account_id]/[gateway-id] \
  --header 'Content-Type: application/json' \
  --header 'cf-aig-authorization: Bearer [cf-aig-token]' \
  --data '[
    {
      "provider": "openai",
      "endpoint": "chat/completions",
      "headers": {
        "Authorization": "Bearer [openai_api_key]",
      },
      "query": {
        "model": "gpt-4o-mini",
        "messages": [
          {
            "role": "user",
            "content": "What is Cloudflare?"
          }
        ]
      }
    }
  ]'

{
    "error": {
        "message": "You didn't provide an API key. You need to provide your API key in an Authorization header using Bearer auth (i.e. Authorization: Bearer YOUR_KEY), or as the password field (with blank username) if you're accessing the API from your browser and are prompted for a username and password. You can obtain an API key from https://platform.openai.com/account/api-keys.",
        "type": "invalid_request_error",
        "param": null,
        "code": null
    }
}

{
    "error": {
        "message": "You didn't provide an API key. You need to provide your API key in an Authorization header using Bearer auth (i.e. Authorization: Bearer YOUR_KEY), or as the password field (with blank username) if you're accessing the API from your browser and are prompted for a username and password. You can obtain an API key from https://platform.openai.com/account/api-keys.",
        "type": "invalid_request_error",
        "param": null,
        "code": null
    }
}

# seems google-ai-studio streaming api not work, anybody know how to fix it?
curl "https://gateway.ai.cloudflare.com/v1/7{account_id}/{gateway_id}/google-ai-studio/v1beta/models/gemini-2.5-flash-preview-05-20:streamGenerateContent?alt=sse" \
           --header 'content-type: application/json' \
           --header 'x-goog-api-key: '(pass GEMINI_API_KEY) \
           --data '{
            "contents": [
                {
                  "role":"user",
                  "parts": [
                    {"text":"What is Cloudflare?"}
                  ]
                }
              ]
            }'

# seems google-ai-studio streaming api not work, anybody know how to fix it?
curl "https://gateway.ai.cloudflare.com/v1/7{account_id}/{gateway_id}/google-ai-studio/v1beta/models/gemini-2.5-flash-preview-05-20:streamGenerateContent?alt=sse" \
           --header 'content-type: application/json' \
           --header 'x-goog-api-key: '(pass GEMINI_API_KEY) \
           --data '{
            "contents": [
                {
                  "role":"user",
                  "parts": [
                    {"text":"What is Cloudflare?"}
                  ]
                }
              ]
            }'

createOpenAI({
baseURL: `https://gateway.ai.cloudflare.com/v1/${env.CLOUDFLARE_ACCOUNT_ID}/${customer.gatewayId}/openai`,
apiKey: env.OPENAI_API_KEY,
headers: {
 'cf-aig-authorization': env.CLOUDFLARE_API_KEY,
},
});

createOpenAI({
baseURL: `https://gateway.ai.cloudflare.com/v1/${env.CLOUDFLARE_ACCOUNT_ID}/${customer.gatewayId}/openai`,
apiKey: env.OPENAI_API_KEY,
headers: {
 'cf-aig-authorization': env.CLOUDFLARE_API_KEY,
},
});