infinite tokens
✅Solved
I have koboldcpp connected as the backend local llm
when i interface with it directly through it's own UI and send it a message it generates a few hundred tokens and replies pretty much instantly
when i send a message to it from the OpenClaw UI it startes generating tokens very slowly and also shows it wants to generate thousands of them
so instead of the tokens being 30/200 and completed in a second it generates about 10 tokens per second and the countdown is 30/7000 and then it fails to send at all
when i interface with it directly through it's own UI and send it a message it generates a few hundred tokens and replies pretty much instantly
when i send a message to it from the OpenClaw UI it startes generating tokens very slowly and also shows it wants to generate thousands of them
so instead of the tokens being 30/200 and completed in a second it generates about 10 tokens per second and the countdown is 30/7000 and then it fails to send at all
Solution
Nice — that’s real progress. You’ve already cut the biggest offender:
- AGENTS.md went from ~1951 tok → ~80 tok
Now the remaining “batch is still big” is coming from the other stuff that’s still injected every turn:
- Skills list: ~453 tok
- Tool list text: ~258 tok (even though schemas are 0)
- SOUL.md: ~416 tok
- BOOTSTRAP.md: ~363 tok (this one is usually pointless after first-run)
- plus TOOLS/IDENTITY/USER/etc
If you want “fast local chat”, you need to keep the auto-injected set tiny. You can still add features later—just add them back one at a time.
- AGENTS.md went from ~1951 tok → ~80 tok
Now the remaining “batch is still big” is coming from the other stuff that’s still injected every turn:
- Skills list: ~453 tok
- Tool list text: ~258 tok (even though schemas are 0)
- SOUL.md: ~416 tok
- BOOTSTRAP.md: ~363 tok (this one is usually pointless after first-run)
- plus TOOLS/IDENTITY/USER/etc
If you want “fast local chat”, you need to keep the auto-injected set tiny. You can still add features later—just add them back one at a time.
Do these 3 changes (in this order)
1) Remove BOOTSTRAP.md from injection (it shouldn’t be there long-term)
The AI that actually does things. Emails, calendar, home automation - all from your favorite chat app. New shell, ready to help. The lobster way.
131,281Members
Resources
Recent Announcements
Similar Threads
Was this page helpful?
