How to make ollama local model work?
"ollama": {
"baseUrl": "http://ollama-host:11434/v1",
"apiKey": "ollama-local",
"api": "openai-responses",
"models": [
{
"id": "qwen3:4b",
"name": "Qwen 3 4B",
"reasoning": false,
"input": [
"text"
],
"cost": {
"input": 0,
"output": 0,
"cacheRead": 0,
"cacheWrite": 0
},
"contextWindow": 200000,
"maxTokens": 8192
},
{
"id": "llama3.2:latest",
"name": "Llama 3.2",
"reasoning": false,
"input": [
"text"
],
"cost": {
"input": 0,
"output": 0,
"cacheRead": 0,
"cacheWrite": 0
},
"contextWindow": 200000,
"maxTokens": 8192
}
]
}
"baseUrl": "http://ollama-host:11434/v1",
"apiKey": "ollama-local",
"api": "openai-responses",
"models": [
{
"id": "qwen3:4b",
"name": "Qwen 3 4B",
"reasoning": false,
"input": [
"text"
],
"cost": {
"input": 0,
"output": 0,
"cacheRead": 0,
"cacheWrite": 0
},
"contextWindow": 200000,
"maxTokens": 8192
},
{
"id": "llama3.2:latest",
"name": "Llama 3.2",
"reasoning": false,
"input": [
"text"
],
"cost": {
"input": 0,
"output": 0,
"cacheRead": 0,
"cacheWrite": 0
},
"contextWindow": 200000,
"maxTokens": 8192
}
]
}
The AI that actually does things. Emails, calendar, home automation - all from your favorite chat app. New shell, ready to help. The lobster way.
83,815Members
Resources
Similar Threads
Was this page helpful?
