llama-cpp + llama-swap, not getting called
Below is an excerpt of my openclaw.json file. I have configured llama.cpp and running llama-server exposing my models. Llama-swap is also running for hot-swap
GLM seems to work but qwen3coder gets an error saying its not supported.
"models": {
"providers": {
"llamacpp": {
"baseUrl": "http://localhost:8083/v1",
"apiKey": "local",
"api": "openai-responses",
"models": [
{
"id": "Qwen3-Coder-Next",
"name": "Qwen3-Coder-Next",
"reasoning": false,
"input": ["text"],
"cost": {
"input": 0,
"output": 0,
"cacheRead": 0,
"cacheWrite": 0
},
"contextWindow": 4096,
"maxTokens": 1024
},
{
"id": "GLM-Flash",
"name": "GLM-Flash",
"reasoning": false,
"input": ["text"],
"cost": {
"input": 0,
"output": 0,
"cacheRead": 0,
"cacheWrite": 0
},
"contextWindow": 4096,
"maxTokens": 768
}
]
}
}
},
"agents": {
"defaults": {
"model": {
"primary": "llamacpp/GLM-Flash"
GLM seems to work but qwen3coder gets an error saying its not supported.
"models": {
"providers": {
"llamacpp": {
"baseUrl": "http://localhost:8083/v1",
"apiKey": "local",
"api": "openai-responses",
"models": [
{
"id": "Qwen3-Coder-Next",
"name": "Qwen3-Coder-Next",
"reasoning": false,
"input": ["text"],
"cost": {
"input": 0,
"output": 0,
"cacheRead": 0,
"cacheWrite": 0
},
"contextWindow": 4096,
"maxTokens": 1024
},
{
"id": "GLM-Flash",
"name": "GLM-Flash",
"reasoning": false,
"input": ["text"],
"cost": {
"input": 0,
"output": 0,
"cacheRead": 0,
"cacheWrite": 0
},
"contextWindow": 4096,
"maxTokens": 768
}
]
}
}
},
"agents": {
"defaults": {
"model": {
"primary": "llamacpp/GLM-Flash"
The AI that actually does things. Emails, calendar, home automation - all from your favorite chat app. New shell, ready to help. The lobster way.
83,815Members
Resources
Similar Threads
Was this page helpful?
