High token usage
Hello, in my llama based fresh setup (no high models and resources, just a basic setup), just a simple greeting creates 11k token length prompt. Which takes too long, bloats it and makes it unusuable.
As I know, the agent has all the info about all the skills(both core and installable) even if they are disabled. Or any system prompt which I could modify.
I want to remove them so lower context to very basic levels. Right now I couldn't find where skills are and where promts are?
Thanks!
As I know, the agent has all the info about all the skills(both core and installable) even if they are disabled. Or any system prompt which I could modify.
I want to remove them so lower context to very basic levels. Right now I couldn't find where skills are and where promts are?
Thanks!
The AI that actually does things. Emails, calendar, home automation - all from your favorite chat app. New shell, ready to help. The lobster way.
83,815Members
Resources
Recent Announcements
Similar Threads
Was this page helpful?
