Cache retention
Do you know what is usually the cache retention duration ? I'm wondering this to take decision how to design my agents to save tokens. Because I know that the context part of each message is cached, but it loses interest if I'm sending one message each hour and the cache entry is evicted after 5 minutes
The AI that actually does things. Emails, calendar, home automation - all from your favorite chat app. New shell, ready to help. The lobster way.
134,827Members
Resources
Recent Announcements
Similar Threads
Was this page helpful?
