You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the bug
Even setting the context window, the summarize function is not called.
I think this happens because "summarize_messages_inplace" is called only when the llm returns error, but claude has 200k, it will take a lot to reach it
And when manually called throws error in anthropic.py here assert len(response_json["content"]) == 2, response_json
Letta Config
Using anthropic with claude 3.5 sonnet latest
Let me know if you need further details,
Thank you!
The text was updated successfully, but these errors were encountered:
Describe the bug
Even setting the context window, the summarize function is not called.
I think this happens because "summarize_messages_inplace" is called only when the llm returns error, but claude has 200k, it will take a lot to reach it
And when manually called throws error in anthropic.py here
assert len(response_json["content"]) == 2, response_json
Letta Config
Using anthropic with claude 3.5 sonnet latest
Let me know if you need further details,
Thank you!
The text was updated successfully, but these errors were encountered: