Source-linked AI summary

EMIR$^2$: Evolution-Aware Memory with Intent-Guided Multi-Round Retrieval

Jinlan Liu, Hongliang Sun, Yong Wang, Bolin Zhang, Dinabo Sui, Dianhui Chu, Zhiying Tu

arXiv:2609.32584v1cs.AI

TL;DR

Long-term LLM memory must handle evolving, sometimes conflicting facts and retrieve evidence scattered across interactions. EMIR2 combines an evolving memory graph with intent-guided multi-round retrieval; experiments on LoCoMo and MemConflict report effectiveness on complex questions and robustness to dynamic and static conflicts.

  • Problem

    Existing memory approaches give limited attention to evolving semantic states, despite long-term interactions containing changing or conflicting facts and scattered evidence.

    Source: §1 · p. 1
  • Method

    EMIR2 pairs a State-Evolving Memory Graph of temporal event trajectories and evidence-grounded semantic states with intent-guided multi-round retrieval that expands to address unresolved evidence needs.

    Source: §1 · pp. 2–3
  • Results

    Experiments on LoCoMo and MemConflict report effectiveness on complex questions and robust memory utilization under dynamic and static conflicts.

    Source: §1 · p. 3, §6 · p. 10
  • Takeaways & Limitations

    The authors conclude that modeling memory evolution alongside adaptive evidence retrieval can enhance long-term reasoning and memory utilization under dynamic and static conflicts.

    Source: §6 · p. 10

Abstract

from arXiv · show

Long-term memory enables large language model (LLM) agents to leverage historical interactions for future tasks. However, existing memory systems struggle to utilize continuously evolving historical information, as they often rely on static memory representations and single-round retrieval strategies, failing to track factual changes or integrate distributed evidence across long-term interactions. To address these challenges, we propose \textsc{EMIR}$^{2}$, an \textbf{E}volution-Aware \textbf{M}emory framework with \textbf{I}ntent-Guided Multi-\textbf{R}ound \textbf{R}etrieval, enabling LLM agents to maintain evolving historical knowledge and adaptively retrieve relevant evidence. Specifically, \textsc{EMIR}$^{2}$ constructs a State-Evolving Memory Graph (SEMG) that represents long-term memory as evolving knowledge states supported by temporal event trajectories and evidential associations. By maintaining semantic states through evidence-based updates, SEMG preserves historical evolution and enables evidence tracing under complex and conflicting scenarios. Building upon this, we introduce an intent-guided multi-round retrieval mechanism that iteratively identifies missing evidence and expands retrieval based on accumulated information. Experiments on LoCoMo and MemConflict demonstrate that \textsc{EMIR}$^{2}$ improves long-term memory utilization, dynamic and static conflict handling, and complex retrieval performance, achieving relative improvements of more than 12\% in certain categories. These results highlight the effectiveness of jointly modeling memory evolution and adaptive evidence acquisition for long-term agent interactions.

1 INTRODUCTION

EMIR2 addresses two challenges in long-term agent memory: preserving how facts evolve with supporting evidence, and retrieving distributed evidence beyond a single query-matched round. It combines a State-Evolving Memory Graph with intent-guided, multi-round retrieval for complex long-horizon queries.

  • Long-term agents must maintain coherent memory as interactions update it and integrate relevant information scattered across historical events.Evolving information can become inconsistent or conflicting, while complex tasks may require evidence from multiple times and events.Source: §1 · p. 1
  • EMIR2 jointly models factual evolution and adaptive evidence-seeking retrieval to address evolving memory and scattered historical evidence in long-horizon tasks.The framework combines SEMG’s evolving states, temporal event trajectories, and evidential associations with retrieval that expands based on unresolved information needs.Source: §1 · p. 2
  • SEMG organizes episodic events into temporal chains and updates evolving semantic states with evidence, preserving factual trajectories for conflict-aware retrieval.This supports tracing how and why facts change, including replacement by newer facts, historical contradictions, and context-dependent preference shifts.Source: §1 · pp. 1–2, Figure 1 · p. 2
  • Intent-guided multi-round retrieval identifies missing evidence and expands the search using accumulated evidence to support complex queries.This addresses single-round retrieval’s limited use of relationships among memories and its difficulty finding complementary evidence not directly matched to the original query.Source: §1 · pp. 2–3
  • Experiments on LoCoMo and MemConflict demonstrate EMIR2’s effectiveness on complex questions and robustness to dynamic and static memory conflicts.Source: §1 · p. 3

2 RELATED WORK

Prior memory research advances memory organization and retrieval but leaves event evolution and memory-structure-guided evidence exploration underused. EMIR^2 addresses these gaps with temporal episodic chains, semantic links, and adaptive retrieval guided by both.

2.1 MEMORY ORGANIZATION

  • Memory systems evolved from episodic records toward workflows, interconnected networks, hierarchical tiers, and online/offline consolidation, but rarely explicitly model how related events evolve over time.MemoryBank adds forgetting and updating; Agent Workflow Memory reuses procedural experience; A-MEM organizes interconnected cards; MemoryOS migrates information across tiers; LightMem separates online processing from offline consolidation. SEMG organizes evolving events into temporal episodic chains with semantic nodes and optional lateral links.Source: §2.1 · p. 3

2.2 MEMORY RETRIEVAL

  • Retrieval methods progress from similarity-based recall to structure-aware and adaptive strategies, yet rarely use memory-structure relationships to guide evidence exploration.LD-Agent (Li et al., 2025b) uses topic-based retrieval; SeCom uses segment-level memories and denoising; MemInsight adds semantic context; Mnemis combines similarity recall with semantic traversal; MRAgent iteratively explores and prunes paths. EMIR^2 retrieves over a chain-like memory graph, using temporal transitions and semantic relations to progressively discover relevant memories.Source: §2.2 · p. 3

3 PROBLEM DEFINITION

Long-term conversational memory retrieval builds persistent structured memory from conversation history, then selects a compact set of relevant memory units for a query to support answer generation.

3 PROBLEM DEFINITION

  • The task is to build persistent memory from historical conversations and retrieve relevant evidence for a given query.Memory units preserve conversation content and contextual information.Source: §3 · p. 4
  • Formally, the system constructs structured memory M = Build(D) from conversation history D = {d1, . . . , dN}.Source: §3 · p. 4
  • For query q, retrieval identifies a compact set R = Retrieve(q, M), R ⊆ M, which is provided to the downstream model for answer generation.Source: §3 · p. 4

4 METHODOLOGY

EMIR2 builds an evolution-aware memory graph from dialogue histories and uses query intent plus accumulated evidence to guide multi-round retrieval. Its memory combines temporal event trajectories with evidence-grounded semantic states that preserve factual evolution.

4.1 STATE-EVOLVING MEMORY GRAPH

  • SEMG combines traceable episodic event chains with evidence-grounded semantic states to support retrieval and reasoning over evolving long-term interactions.Episodic memory preserves historical events, while semantic states track factual knowledge as it changes.Source: §4.1 · p. 4

4.1.1 EPISODIC MEMORY CONSTRUCTION

  • Events extracted from local dialogue windows are assigned to topic-specific chains and ordered chronologically when temporal information is available.Temporal paths are complemented by classified relations—including causality, contextual relevance, and follow-ups—that connect events within or across topics.Source: §4.1.1 · p. 5

4.1.2 SEMANTIC STATE EVOLUTION

  • Semantic states are updated by reinforcing or extending facts, revising replaced or retracted knowledge, or marking evidence insufficient for change.Revisions create successor states and preserve prior knowledge; event arrival alone does not require a new state.Source: §4.1.2 · p. 5

4.2 INTENT-GUIDED MULTI-ROUND RETRIEVAL

  • Intent-guided retrieval iteratively assesses accumulated evidence, identifies gaps, and selects constrained graph operations until evidence is sufficient or the retrieval budget is exhausted.Retrieved nodes are deduplicated, kept within a total candidate budget, and reranked using model relevance and retrieval signals before the top K are returned.Source: §4.2 · p. 6

5 EXPERIMENT

EMIR2 shows strong LoCoMo results for temporal and multi-hop questions and performs strongly in dynamic and static conflict scenarios on MemConflict. Ablations and retrieval-budget analysis support the contributions of multi-round retrieval, semantic states, and adaptive stopping.

5.1 EXPERIMENT SETTINGS

  • Evaluation covers LoCoMo’s single-hop, temporal, multi-hop, and open-domain questions, as well as overall accuracy, and uses MemConflict to assess handling of conflicting histories.LoCoMo evaluates retrieval from ultra-long dialogue memory; MemConflict evaluates handling of conflicting user histories.Source: §5.1 · p. 7

5.2 MAIN RESULTS

  • EMIR2 shows particularly strong LoCoMo temporal and multi-hop results, remains competitive with a lightweight Qwen3.5-9B controller, and outperforms MRAgent overall under both backbone settings.With the Claude Sonnet 4.5 backbone, replacing the lightweight controller with the backbone LLM further improves aggregate multi-hop and temporal performance, but not uniformly across questions.Source: §5.2 · pp. 7–8

5.3 ABLATION STUDY

  • Disabling multi-round retrieval or semantic nodes degrades performance, especially on multi-hop questions, while removing cross-chain edges causes no significant drop.The ablation variants test single-retrieval answering, removal of SEMG lateral edges, and removal of semantic nodes.Source: §5.3 · p. 8, Figure 3 · p. 8

5.4 CONFLICT-AWARE MEMORY EVALUATION

  • On MemConflict, EMIR2 performs strongly in dynamic and static conflict scenarios, but conditional conflicts remain challenging because they require context-dependent filtering of valid information.The evaluation reports black-box answering accuracy and white-box retrieval performance.Source: §5.4 · pp. 8–9, Table 2 · p. 9

5.5 EFFECTIVENESS–EFFICIENCY TRADE-OFF OF MULTI-ROUND RETRIEVAL

  • Increasing the retrieval-round budget initially improves evidence recall and answer accuracy, but gains become marginal beyond a threshold as token consumption rises.Adaptive termination lets EMIR2 stop when sufficient evidence has been collected, balancing evidence acquisition against retrieval overhead.Source: §5.5 · p. 9, Figure 4 · p. 9

6 CONCLUSION · A MEMORY RELATION TAXONOMY AND CONSTRUCTION PROMPTS · B ADAPTIVE RETRIEVAL PROMPTS

This section summarizes EMIR2’s evolving-memory and adaptive multi-round retrieval approach for using historical evidence, including its SEMG relation taxonomy and construction and retrieval prompts. It also details how retrieval identifies evidence gaps, expands promising graph neighborhoods, and reranks candidates while distinguishing direct support from evidence useful for inference.

6 CONCLUSION

  • The framework combines temporal event chains, semantic states, and adaptive multi-round retrieval; experiments on LoCoMo and MemConflict show improved long-term reasoning and memory use under dynamic and static conflicts.Future work will explore finer-grained context-dependent memory modeling and efficient retrieval for scalable long-term agent systems.Source: §6 · p. 10

A.1 MEMORY RELATION TAXONOMY

A.2.1 WINDOW-LEVEL MEMORY EXTRACTION

  • Memory construction uses five stages: window planning and extraction, entity normalization, semantic refinement, and cross-window event-relation determination.The extraction stage turns each historical window into episodic events, candidate semantic entries, and local relations; it separates temporary details into events and stable information into candidate claims.Source: §A.2 · p. 14, §A.2.1 · pp. 14, 16

A.2.2 SEMANTIC REDUCTION

  • Semantic reduction reconciles incoming claims with the topic chain’s confirmed fact snapshot through reinforce, add, replace, or retract operations, leaving conflicting or insufficiently supported updates pending.An uncertain update retains its proposed operation without changing the active canonical state.Source: §A.2.2 · p. 17

A.2.3 CROSS-WINDOW EVENT-RELATION ADJUDICATION

  • Cross-window relation adjudication independently checks candidate event pairs and relation direction against event summaries and evidence, conservatively rejecting unsupported relations.Candidate-generation signals are non-binding: the adjudicator may accept, override, or reject a proposed relation.Source: §A.2.3 · p. 18

B ADAPTIVE RETRIEVAL PROMPTS

  • Adaptive retrieval uses model-based control for question decomposition, iterative evidence evaluation, graph expansion, semantic state refinement, and final evidence reranking.The appendix provides prompts for query decomposition, iterative retrieval control, graph-expansion source selection, and final reranking.Source: B ADAPTIVE RETRIEVAL PROMPTS · p. 18

B.1 QUESTION DECOMPOSITION GATE

  • Before multi-round retrieval, a question-decomposition gate determines whether the query needs to be split into multiple retrieval targets.When decomposition is needed, the controller generates complementary sub-questions using the query, question type, retrieval requirements, and evidence from initial retrieval.Source: §B.1 · p. 19, §B.2 · p. 19

B.2 INITIAL SUBPROBLEM PLANNING

  • Initial subproblem planning uses the detected question type, required information, and pre-retrieved evidence—including temporal details, salient facts, and retrieval provenance—to generate complementary sub-questions.This planning stage runs only after decomposition has been determined to be necessary.Source: §B.2 · p. 19
  • Initial planning generates complementary subproblems that search for distinct facts, constraints, patterns, or explanations, and divides multi-event retrieval by event type or time range.Only information necessary to answer the root question is marked required.Source: §B.2 · p. 20

B.3 ITERATIVE EVIDENCE ASSESSMENT

  • Evidence assessment checks whether the root question and required subproblems are supported, then derives focused retrieval probes and graph actions from any remaining gaps.Indirect evidence may jointly support inference, while factual questions require matches to the requested constraints; retrieval stops when the answer and required reasoning links are supported.Source: §B.3 · pp. 20–21

B.4 EXPANSION SOURCE SELECTION

  • When evidence is insufficient, the controller selects up to five candidate memories whose graph neighborhoods are likely to expose missing evidence, even if the memories do not directly answer the question.It favors bridge, connector, entity, relation, causal, or temporal anchors, using candidate summaries and graph-edge metadata.Source: §B.4 · pp. 21–22

B.5 FINAL EVIDENCE RERANKING

  • The final reranker independently scores every candidate for support of the original question, favoring direct or necessary indirect evidence over merely topical or redundant matches.For factual questions, scores depend on matching the requested subject, relation, facet, occurrence, ordinal, and temporal constraints; auxiliary modules also provide retrieval hints and slim semantic-state nodes to retain relevant facts and source evidence.Source: §B.5 · pp. 22–23

C ANALYSIS OF RETRIEVAL CONTROLLER CAPACITY

Under the Claude Sonnet 4.5 backbone, a stronger retrieval controller improves EMIR2’s aggregate multi-hop and temporal scores, though the gains are not uniform across questions.

  • The main experiments use Qwen3.5-9B as a lightweight retrieval controller, which slightly underperforms MRAgent on the multi-hop and temporal subsets.The capacity comparison replaces it with Claude Sonnet 4.5 and examines instance-level retrieval behavior to identify decisions that benefit from greater capacity.Source: C ANALYSIS OF RETRIEVAL CONTROLLER… · p. 23
  • With Claude Sonnet 4.5 as retrieval controller, multi-hop score rises from 88.53 to 91.49 and temporal score from 85.25 to 87.54, exceeding corresponding MRAgent results.All other EMIR2 configurations remain unchanged; aggregate gains do not mean the stronger controller is better for every question.Source: Table 4 · p. 23, C ANALYSIS OF RETRIEVAL CONTROLLER… · p. 23

C.1 INSTANCE-LEVEL ANALYSIS

At the instance level, Claude Sonnet 4.5 improves predictions on some questions but worsens others; its advantage is associated with more targeted evidence acquisition, not deeper retrieval.

C.1 INSTANCE-LEVEL ANALYSIS

  • The analysis characterizes retrieval behavior using one Qwen3.5-9B run with complete trajectories aligned to Claude runs by question, while Table 4 reports Qwen averages across three runs.The authors interpret the instance-level findings as improved retrieval decision quality in fine-grained scenarios, not a uniform benefit from more extensive retrieval.Source: §C.1 · pp. 23–24
  • 31 predictions change from incorrect to correct with the Claude controller, while 16 change from correct to incorrect, so gains are concentrated in a subset of questions.The transitions compare Claude Sonnet 4.5 with Qwen3.5-9B.Source: Table 5 · p. 23, §C.1 · p. 23
  • Claude uses fewer retrieval rounds on average while retaining complete supporting evidence for a larger proportion of questions and decomposing questions more often.Complete Gold is the proportion of questions for which all annotated supporting evidence is retained.Source: §C.1 · p. 23, Table 6 · p. 24
  • More frequent decomposition helps acquire complementary evidence when questions involve multiple entities, events, or temporal constraints.The stronger controller more often turns the original question into more specific subquestions.Source: §C.1 · pp. 23–24

D ANALYSIS OF CROSS-CHAIN EDGES

Cross-chain edges add direct semantic pathways between memories on different topics, expanding retrieval and evidence discovery. Removing them limits graph exploration, but iterative intent-guided retrieval can compensate and keep final performance relatively stable.

D ANALYSIS OF CROSS-CHAIN EDGES

  • Cross-chain edges connect semantically related memories across topics, adding non-local reasoning paths that temporal chains alone cannot represent.Their contribution is to provide additional, more direct connections among related memories.Source: D ANALYSIS OF CROSS-CHAIN EDGES · p. 24
  • Removing cross-chain edges reduces graph expansion and retrieved candidates, but final performance remains relatively stable because multi-round retrieval can explore alternative evidence paths.Without explicit cross-topic connections, the retriever can still find relevant memories through other relations and iterative retrieval.Source: Table 7 · p. 24, D ANALYSIS OF CROSS-CHAIN EDGES · p. 24
  • Cross-chain edges contribute additional evidence paths, while most evidence remains recoverable through other retrieval processes and adaptive iterative exploration.This compensatory retrieval moderates the effect of missing connections on final answer quality.Source: Table 8 · p. 24, D ANALYSIS OF CROSS-CHAIN EDGES · p. 24

E DETAILED MEMCONFLICT EVALUATION

The section presents detailed MemConflict results from black-box and white-box perspectives, with higher scores indicating better performance and averages spanning three conflict types.

E.1 BLACK-BOX PERFORMANCE

The black-box evaluation assesses final answer correctness and whether memory systems resolve dynamic and static conflicts appropriately.

  • Black-box performance is assessed with AA for answer correctness, UOCS for following temporal update order in dynamic conflicts, and CRS for resolving static contradictions.Source: §E.1 · p. 25
  • Table 9 reports MemConflict black-box performance by conflict type, marking the best overall methods in bold and the best baselines with underlining.Source: Table 9 · p. 25

E.2 WHITE-BOX RETRIEVAL ANALYSIS

The white-box analysis evaluates whether memory systems retrieve supporting evidence and rank it effectively, with MemConflict results organized by conflict type.

E.2 WHITE-BOX RETRIEVAL ANALYSIS

  • SEH@3 measures supporting-evidence inclusion in the top three retrieved memories, while SRS measures its ranking quality; Table 10 reports both by MemConflict conflict type.The table caption states that bold values mark the best performance overall and underlined values mark the best among baselines.Source: §E.2 · p. 25, Table 10 · p. 25
Loading 2609.32584v1…