Hi, @Zack, I am having the same issue... Have you managed to solve the bug/error here?
Hi, @Zack, I am having the same issue... Have you managed to solve the bug/error here?
ZOh we did. Eventually we had to set the token and the specific header the have for the secure token. It’s the same value and a bug but it makes it work
K@Zack Finally figure how the protocol works. the worker managed to talk to the AI gateway.... how much brain cells I have destroyed LOL
ZI hear you. It took a while but after its pretty good
K@Zack It would be nice to be able to find good documentation 
ZIn the teams defense it is a fast evolving space
Ait doesn't seem that
cache_control is being passed quite right for anthropic when using the openai compat endpoint
DHi Will you support Minimx M2 as. Provider seems like a kick ass open source model - https://www.minimax.io/news/minimax-m2
Build with next-gen AGI: MiniMax offers Foundation AI models (text/audio/image/video). Power products like Talkie, Hailuo AI & enterprise APIs. Scalable, secure AI solutions for 50K+ global businesses.
DFYI AI Gateway is even incorrectly labeling an API overloaded error as successful, because it's not correctly looking at the streamed error.
Agoogle vertex AI is responding with 400s out of nowhere, but it works without using the gateway, there's no response attached
ZAre people still being accepted for the unified billing for the AI gateway? I applied a while back but never got accepted
JWe set up Logpush to get our AI Gateway logs exported, but one thing I saw was that the Cost data wasn't available. I see the token usage, but no cost. Is this intentional or did I do something wrong when exporting?
CKI am having so much issue with AI gateway. Even the same coding, same tokens, same configuration and same permission was working the day before but won't work the next day. There is no consistency here. I am thinking I am giving up on working on anything around AI gateway. No helpful support from cloudflare. Sometimes, wasted lots of time to troubleshoot. Can't work with something that work occassionally. Such a disppointment! I need to find another platform. Even GCP doesn't have so much issue but lack of security. I am so disappointed with cloud flare.
BI am trying to setup some dynamic routes, the visual editor is nightmare to deal with... it is buggy and I have to constantly refresh to get it working and the visualization isn't that helpful. My workflow isn't that complicated (just some rate limiting + fallbacks). We are developers and this is for developers, so can we just have some nice JSON/YAML editor instead? I write if-else better than dragging boxes.
KSomething is wrong with the AI gateway and/worker AI since a few days ago. The AI gateway stop responding on other questions except for "What is Cloudflare?". It took me a few days wondering why everything doesn't work since a few days ago
Taccording to your experience, wts the best web search API + model routing for AI agents :happy: and why
AThe ai gateway keeps flagging the AutoRAG content as jailbreak (I'm just sending Mechanical Engineering content), I've tried adding it to the system message and also as an assitant message later. Any tips on preventing this? We'd like to keep it enabled if possible
CWhat would be amazing in gateway would be some sort of user analytics, openai and other proviers allow passing a
userYou can do this by passing in metadata. Here is the Typescript code we use
JThen you can filter the data in the dashboard
CNice
Cthanks
Bany help plz?
NNi need to get these values apparently
N
Nbut i don't get where
Nno envs here
Ni do have google ai studio there
IAPI Key needs to be generated from https://dash.cloudflare.com/?to=/:account/api-tokens and needs to have the AI Gateway permission. Gateway Endpoint looks correct already, assuming that's your proper Account ID in there.
SDo CF worker AI models have rate limits for tokens? On the limts page, I can see RPM limits but not TPMs (beyond the context window of the model)
NScribe v2 best model and not availiable?
NIt is my understanding that if we enable billing we should be able to setup an authenticated gateway and then call any LLM provider supported by AI Gateway without providing the provider’s API key (since CF is handing the billing). However, if I issue a curl and do not provide the underlying provider’s API key, I get an error stating that I must provide it (in addition to the AI Gateway’s token which I generated in CF with the run permission). This makes no sense to me. Isn’t the whole point to be able to provide ONE key, access any provider and pay one bill to CF for all inferencing. This is the way the Vercel AI Gateway works but I want to host fully on CF.
CAnyone managed to connect dynamic models with
ai-sdk? this fails with a vague internal server error
CThis works if anyone searches this:
Dhey there, what's the trick to get token count and costs on the UI? I've tried sending my own
cf-aig-custom-cost to no avail
DP.S if someone is "stuck" with Boto3 for Amazon Bedrock, it's doable https://gist.github.com/DDuarte/6bd7e3851e6519c988037f883f80eeb1
AI'm trying to use Claude 4-5 Sonnet on Azure Foundry through the AI Gateway -- is this platform currently supported? I'm only seeing "Azure OpenAI" as a provider option on the page (which, as I understand, is limited only to a select set of OpenAI models).
LIs it known that AI Gateway with Unified Billing (Beta) doesn’t seem to work with OpenAI when using the Vercel AI SDK together with Cloudflare’s ai-gateway-provider package?
In my testing:
• OpenAI → fails entirely through Unified Billing
• Google Generative AI → the non-streaming functions (generateText, generateObject) work, but the streaming variants do not
• Anthropic → both streaming and non-streaming work as expected
This seems odd, since the documentation states that Unified Billing supports all of these providers. Is this a known limitation or an issue on Cloudflare’s side?
I know it’s still beta but just want to know.
In my testing:
• OpenAI → fails entirely through Unified Billing
• Google Generative AI → the non-streaming functions (generateText, generateObject) work, but the streaming variants do not
• Anthropic → both streaming and non-streaming work as expected
This seems odd, since the documentation states that Unified Billing supports all of these providers. Is this a known limitation or an issue on Cloudflare’s side?
I know it’s still beta but just want to know.
NI hope you get an answer to this because I’m struggling with the same thing.
LHoping on an answer from an employee, they might know more
NShould be able to specify ‘openai/gpt-5’ or ‘groq/gpt-oss-120b’ as the model and it should work, but it doesn’t.
LI use the vercel ai sdk with a provider registry and do it like that instead. You can specify your provider/model that way.
LStill hoping for clarification on this
VIs there an progress on supporting
v1 and v1-preview data plane API version (in azure) for ai gateway? Currently it breaks - unable to find resource (I assume url changes)Vv1 is the new GA version for a while now and the azure adapter in cercel ai sdk now defaults to it as well, breaking any usage relying on defaultsNI’m pretty close to giving up on Cloudflare and just paying $20 to Vercel.