# Researchers introduce MemPABench to evaluate personal agent memory

Digest AI · Research · published 2026-10-23T04:00:00Z

Canonical: https://digestai.news/story/researchers-introduce-mempabench-to-evaluate-personal-agent-memory

## Summary

A new benchmark called MemPABench has been released to test how personal AI agents remember and act on users' interaction preferences. The environment simulates four grounded users, each with 14 work‑ and personal‑context preferences, generating 99 sessions over four months and including five event‑driven preference changes per user.

The authors evaluated four memory systems built on four large‑language‑model backbones. Retrieval‑based approaches such as Mem0, MemOS, and simple RAG showed no advantage over a no‑memory baseline, while a file‑based memory improved selection accuracy but often applied preferences outside the relevant context. Overall, the study finds that current memory mechanisms provide limited gains in preference selection and struggle to adapt to changing user preferences, even when the correct preference is available.

The benchmark and dataset are publicly available at https://mempabench.com for further research on reducing interaction burden in personal intelligence systems.

## Key points

- MemPABench simulates four users with 14 preferences each across 99 sessions over four months.
- Four memory systems on four LLM backbones were tested; retrieval‑based methods did not beat a no‑memory baseline.
- File‑based memory improved accuracy but often applied preferences beyond the relevant context.

## Why it matters

Understanding and improving how agents retain user preferences is crucial for reducing interaction friction and making personal AI assistants more useful in daily life.

## Sources

1. [Why Bother Me Again? Benchmarking Personal Agent Memory for Interaction Preferences](https://arxiv.org/abs/2610.30485) (arXiv cs.AI, 2026-10-23, primary source)

Part of the developing story: [The Rise of External Memory in AI Agents](https://digestai.news/thread/tencent-releases-hy-memory-30b-a3b-for-external-memory-frameworks) (2 stories)

## Cite

Digest AI, "Researchers introduce MemPABench to evaluate personal agent memory", 23 October 2026, https://digestai.news/story/researchers-introduce-mempabench-to-evaluate-personal-agent-memory

---

Written by Digest AI's editorial model from the linked sources; the sources are the record. Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse
JSON: https://digestai.news/story/researchers-introduce-mempabench-to-evaluate-personal-agent-memory.json