Skip to main content

Multi-Tier Memory System

Runtime-switchable memory backends — start in memory, switch to Redis, MongoDB, or SQL database storage when the application needs persistence.

Quick Start

The default in_memory backend is enough for local development and tests:
Install the backend extra before using a durable store:

Available Backends


Conversation Summarization

OmniCoreAgent includes automatic conversation summarization to manage long conversation histories efficiently. When enabled, older messages are condensed into summaries, keeping context while reducing token usage.

Summarization Modes

Retention Policies

How It Works

  1. When conversation exceeds configured limit → summarization triggers
  2. Older messages are sent to LLM for summary generation
  3. Summary replaces older messages in active context
  4. Original messages are retained (with "keep") or deleted per policy
Enable summarization for long-running conversations (support bots, research assistants) to maintain context while controlling costs. Use sliding_window for predictable behavior, token_budget for strict cost control.