What we study
We study how memory systems for AI agents should be evaluated. Finding the right fact is one test. The question we are working toward is whether memory makes an agent better at its task.
One loop for every system. We run every memory system, our own included, through the same test loop, with the same model writing the answers, so the memory system is the only thing that changes.
Memory that changes over time. We test whether a system keeps its memory correct as facts change: when a new decision replaces an old one, when the answer depends on the date, and when several memories should become one.
The surface agents actually use. We can test a system through its own MCP tools, the same surface a real agent touches, not only through its code library.
None of this work uses your memories. We test on public test sets and on test data we build ourselves. We are writing this work up as a paper, and results will appear here once it is published.
