Cloudflare Developers

CD

Cloudflare Developers

Welcome to the official Cloudflare Developers server. Here you can ask for help and stay updated with the latest news

Join
CACameron Aaron4/23/2024

Anthropic on universal Gateway

``` import requests import json def test_anthropic_api():...
Bben_makes_stuff4/20/2024

Groq support & cases for Custom base URL

Any plans to support Groq? https://console.groq.com/docs/openai Groq's API is implemented the same as the OpenAI API spec, so I would think it'd be relatively straightforward to add them as a provider I want to use them as their cost per million tokens is very competitive, but I'll need a fallback provider (OpenAI or something else) if they fail, which is where I'm hoping AI gateway can come in 🙏...
EElektra4/2/2024

What headers come back?

I have one question. If I use Azure and I move to ai gateway will I still be able to receive the headers from Azure? I tend to use simple fecth and since it's a fetch I was wondering if the original headers are also provided. Thank you.
Lluna3/7/2024

any chance we'll see something like this

any chance we'll see something like this for the models cloudflare uses?
PPedro2/8/2024

Also on the roadmap is the possibility

Also on the roadmap is the possibility to create Gateways via API, so that should also help for your use case, no?
Ssergey1/25/2024

Trying to use replicate via Ai Gateway

Trying to use replicate via Ai Gateway with universal endpoint, but can't get it work. Sending the example payload ``` { "version": "5fe0a3d7ac2852264a25279d1dfb798acbc4d49711d126646594e212cb821749",...
AZalex | zellic.io11/7/2023

I'm also interested in having the AI

I'm also interested in having the AI gateway store API keys and protect that with cloudflare zero trust. I'm currently doing that with a worker but I'm curious if there are plans to support secrets management natively