Changing models mid-session after “Context overflow: prompt too large for the model” error
I’ve tried changing models to a model with a substantially larger context window, and the logs confirm the new model’s name being used, however, the logs also show that the context window size is unchanged and I keep getting the same error.
Specifically I’m trying to switch from opus 4.6 (200k context) to sonnet 4.5 (1M context), but the logs show an error of “prompt is too long: 284628 tokens > 200000 maximum”.
What’s really wild is that the logs also show a few messages ago when I tried to manually compact, that the context was 87k/1.0m, but then says “Compaction failed: Turn prefix summarization failed: 400” and then “prompt is too long: 284628 tokens > 200000 maximum”…. So part of it registers the increased context, but a different part still doesn’t?
How to fix without resetting this convo?
Specifically I’m trying to switch from opus 4.6 (200k context) to sonnet 4.5 (1M context), but the logs show an error of “prompt is too long: 284628 tokens > 200000 maximum”.
What’s really wild is that the logs also show a few messages ago when I tried to manually compact, that the context was 87k/1.0m, but then says “Compaction failed: Turn prefix summarization failed: 400” and then “prompt is too long: 284628 tokens > 200000 maximum”…. So part of it registers the increased context, but a different part still doesn’t?
How to fix without resetting this convo?
The AI that actually does things. Emails, calendar, home automation - all from your favorite chat app. New shell, ready to help. The lobster way.
85,605Members
Resources
Similar Threads
Was this page helpful?
