Cloudflare Developers•2mo ago

Are there any plans for open sourcing

Are there any plans for open sourcing Omni? I would love to contribute if that is possible

samjs•11/6/25, 8:16 PM

Not that I'm aware of, but I'll pass along the suggestion!

zsueoOP•11/6/25, 8:18 PM

Namely I would really like to help with the api typings and tool calling

zsueoOP•11/6/25, 8:19 PM

if omni itself is to valuable to opensource, just that part would be enough for me

samjs•11/6/25, 8:21 PM

Can you say more about those? I'm not sure those are directly related to omni itself. Omni is more of the infrastructure part: https://blog.cloudflare.com/how-cloudflare-runs-more-ai-models-on-fewer-gpus/

The Cloudflare Blog

How Cloudflare runs more AI models on fewer GPUs: A technical deep...

In order to support a growing catalog of AI models while maximizing GPU utilization, Cloudflare built an internal platform called Omni. This platform uses lightweight isolation and memory over-commitment to run multiple AI models on a single GPU, allowing us to serve inference requests closer to users and improve overall availability across our ...

zsueoOP•11/6/25, 8:33 PM

Ah I was under the impression that the api surface was directly tied to omni. I guess my request is to open source the worker that sits ontop of omni

samjs•11/6/25, 10:29 PM

So a lot of the API types are technically open source here: https://github.com/cloudflare/workerd/blob/main/types/defines/ai.d.ts

I say "technically" because we currently have a part-script, part-manual approach to updating those based on schemas, etc. So I don't think it's the easiest thing to contribute to at the moment. We have some work we want to do here though, and we can see if that effort can be made open source. We would definitely love to get some help with maintaining those, it's a large surface area and a great place for the community to help.

GitHub

workerd/types/defines/ai.d.ts at main · cloudflare/workerd

The JavaScript / Wasm runtime that powers Cloudflare Workers - cloudflare/workerd

zsueoOP•11/6/25, 11:06 PM

I see! Thanks for taking the time to explain! I'm really eager to improve the typing on all of the ai products

Are there any plans for open sourcing

Similar Threads

Similar Threads

Similar Threads