How To Reduce Token Usage?
My token usage is skyrocketing. In under 10 simple texts back and forth after a new session it went from 10k to 40k tokens per message now.
"native_tokens_cached": 38631,
"native_tokens_prompt": 38738,
in a message that said "hi"
I've read the famous doc everyone talks about but it doesn't seem to work.
"native_tokens_cached": 38631,
"native_tokens_prompt": 38738,
in a message that said "hi"
I've read the famous doc everyone talks about but it doesn't seem to work.
The AI that actually does things. Emails, calendar, home automation - all from your favorite chat app. New shell, ready to help. The lobster way.
134,827Members
Resources
Recent Announcements
Similar Threads
Was this page helpful?
