首页 > AI前沿 > MoM: Memory of Memory

MoM: Memory of Memory

arXiv自然语言 2026-09-07 19:59 3 阅读 查看原文

For a long-horizon LLM agent, the memory question is not what was once recorded but what currently holds.

Most designs answer it only indirectly: every interaction is stored, and the present is reconstructed at query time by retrieving and reconciling records, so stale values re-enter and the same conflicts are re-litigated.

Committing the current value at write time avoids this, but existing write-time (CRUD) memories overwrite, so a wrong update is unrecoverable and prior state is lost.

We take the missing combination---commit on arrival while retaining what is displaced---and formalize it as Memory of Memory (MoM): memory tracks not only content but the provenance, status, and history of its own entries.

We instantiate MoM as Provenant Memory (P-Mem), a typed provenance graph whose active frontier exposes one current value per resolved key while displaced values are retained as provenance; typed operations decide whether a new observation supports, supersedes, contests, rejects, revokes, or resolves an existing value.

P-Mem's decisive gain is validity rather than accuracy: its turn-level read matches the strongest retrieval memory in accuracy at $\sim$4$\times$ fewer read tokens---a retrieval-granularity effect---while graph-guided turn pruning cuts the knowledge-update stale-answer rate (19.4$\%$\rightarrow$10.9$\%$); on revision chains it stays at 100$\%$ where query-time reading collapses to 25$\%$, and, because displaced values are retained rather than overwritten, it recovers committed errors a CRUD memory cannot (100$\%$ vs.\ 0$\%$).