Google-Vertex + BYOK/AI SDK support on AI Gateway

I see google vertex was removed as a provider from the ai-gateway-provider package and the commit says it no longer works with BYOK? Why can I still provide one in dashboard then? Will this be added back or is this permanent?

Rishit Bansal•12/12/25, 7:10 AM

Hi! We do still support BYOK + google vertex SDK on direct requests to AI gateway, its just specifically not supported on the ai-gateway-provider on AI SDK. This is because the latest version of AI SDK requires passing a service account JSON from vertex to AI SDK on client side validations, but in our BYOK setup, this key is stored/used on AI gateway on server side. We're figuring out the best way to make this work with AI SDK, but as such, yes, this will be added back. cc @Palash can also add a bit more context

Palash•12/12/25, 11:14 AM

Opened a PR to add vertex support

https://github.com/cloudflare/ai/pull/326

should be merged and released in a day

GitHub

Add Google Vertex factory wrapper for BYOK/Unified billing support ...

The official @ai-sdk/google-vertex (/edge) expects google credentials (private key etc) which it exchanges for a token, therefore the trick we use in other factory wrappers to provide a dummy token...

RRishit Bansal Hi! We do still support BYOK + google vertex SDK on direct requests to AI gatewa...

LemmoTrestoOP•12/12/25, 3:07 PM

Ah this makes sense thanks for the explanation!

PPalash Opened a PR to add vertex support https://github.com/cloudflare/ai/pull/326 sh...

LemmoTrestoOP•12/12/25, 3:07 PM

Nice! This was quick, thanks for your work!

Google-Vertex + BYOK/AI SDK support on AI Gateway

Similar Threads

Similar Threads

Similar Threads