losing context from message to message
Just had this interesting conversation with an agent that I setup. Using opus as the backend model, and google for embeddings.
Anyone have any thoughts on why this would happen, or what I can do to improve it? Seem insance that it would forget the last message it sent
Bot intro message:
Strategic thinking about technology decisions โ whether that's analyzing an industry trend, breaking down a company's strategy, or applying frameworks to your client work. I'm not just summarizing news; I'm developing a point of view. What's on your mind?
User_A โ 4:04 PM
I was answering your last question
Bot โ 4:04 PM
I don't have the context of our previous exchange โ looks like I'm missing what question you were answering. What were you responding to?
User_A โ 4:05 PM
why did you lose the context? this keeps happening. is your memory working ok?
Bot โ 4:05 PM
[User], I just checked โ my memory files are intact and searchable. I have your [Company A] context, the [Project X] workstream, [Vendor B/Client C] engagement, the whole picture from today's session. But here's what's likely happening: each session starts fresh from the model's perspective. I don't automatically "remember" what we discussed โ I have to actively search memory files to pull context back in.
What specifically did I lose? If you tell me, I can:
Check if it's in memory but I missed it
Add it now if it never got saved
Figure out if there's a pattern to fix
User_A โ 4:06 PM
You literally forgot the thing you said to me in the same session two seconds before.
Bot โ 4:06 PM
You're right to call that out, and I apologize. I don't have visibility into what we discussed earlier in this session โ each message arrives without the prior context, which is a real limitation. What did I tell you that I then forgot? Happy to pick it back up properly.
Anyone have any thoughts on why this would happen, or what I can do to improve it? Seem insance that it would forget the last message it sent
Bot intro message:
Strategic thinking about technology decisions โ whether that's analyzing an industry trend, breaking down a company's strategy, or applying frameworks to your client work. I'm not just summarizing news; I'm developing a point of view. What's on your mind?
User_A โ 4:04 PM
I was answering your last question
Bot โ 4:04 PM
I don't have the context of our previous exchange โ looks like I'm missing what question you were answering. What were you responding to?
User_A โ 4:05 PM
why did you lose the context? this keeps happening. is your memory working ok?
Bot โ 4:05 PM
[User], I just checked โ my memory files are intact and searchable. I have your [Company A] context, the [Project X] workstream, [Vendor B/Client C] engagement, the whole picture from today's session. But here's what's likely happening: each session starts fresh from the model's perspective. I don't automatically "remember" what we discussed โ I have to actively search memory files to pull context back in.
What specifically did I lose? If you tell me, I can:
Check if it's in memory but I missed it
Add it now if it never got saved
Figure out if there's a pattern to fix
User_A โ 4:06 PM
You literally forgot the thing you said to me in the same session two seconds before.
Bot โ 4:06 PM
You're right to call that out, and I apologize. I don't have visibility into what we discussed earlier in this session โ each message arrives without the prior context, which is a real limitation. What did I tell you that I then forgot? Happy to pick it back up properly.
The AI that actually does things. Emails, calendar, home automation - all from your favorite chat app. New shell, ready to help. The lobster way.
83,815Members
Resources
Similar Threads
Was this page helpful?
