CF OT + OLLAMA API
Hey there,
We're trying to set up a local AI )OLLAMA) with CF Tunnels via docker and was wondering how one might go about securing OLLAMA API with an auth token?
There is a basic auth header but where should that go?
How we imagined things working is:
URL: ai.example.tld (We could have CF direct users to the path: v1/chat/completions)
Currently if someone hits ai.example.tld it says OLLAMA is running just by sending them to the local service: ollama:11434
Isn't that a security risk because there is no authentication?
Can we have it where you hit ai.example.tld, authenticate with CF Access application or maybe a Service auth token so that you can just hit ai.example.tld with the token to authenticate against?
Sorry for going all over the place...
We're trying to set up a local AI )OLLAMA) with CF Tunnels via docker and was wondering how one might go about securing OLLAMA API with an auth token?
There is a basic auth header but where should that go?
How we imagined things working is:
URL: ai.example.tld (We could have CF direct users to the path: v1/chat/completions)
Currently if someone hits ai.example.tld it says OLLAMA is running just by sending them to the local service: ollama:11434
Isn't that a security risk because there is no authentication?
Can we have it where you hit ai.example.tld, authenticate with CF Access application or maybe a Service auth token so that you can just hit ai.example.tld with the token to authenticate against?
Sorry for going all over the place...
Welcome to the official Cloudflare Developers server. Here you can ask for help and stay updated with the latest news
87,353Members
Resources
Similar Threads
Was this page helpful?
