Long-term memory · Technical report
Cook Memory: Finding the Right Context Across Conversations
The right context. Even conversations later.
- Austin WorthingtonClient Acquisition.io
Published September 5, 2026 · 5 pages
Abstract
Cook Memory combines planned keyword searches, semantic retrieval, reciprocal rank fusion, cross-encoder reranking, and answer-oriented ordering. On the recorded LongMemEval-S evaluation, the final pipeline reached 98.5% Recall@5, 98.9% Recall@10, and 90.2 mean reciprocal rank on a 0-100 scale. A single keyword-query baseline recorded 83.6% Recall@5.
The measured improvement is 14.9 percentage points in top-five recall within Cook’s evaluation. The research asks a practical question: can the agent retrieve the earlier exchange that contains the evidence needed now, despite unrelated conversations around it?
Results
- 98.5%Cook MemoryAnswer-bearing excerpts
- 95.2%agentmemoryPublished · gold sessions
Cook: 476 answerable questions, scored on answer-bearing excerpts. agentmemory: published 500-question session-retrieval evaluation. Different retrieval units and cohorts; reference comparison, not an identical-harness rerun. Retrieval is separate from final-answer accuracy.
- 98.9%Cook MemoryAnswer-bearing excerpts
- 98.6%agentmemoryPublished · gold sessions
Cook: 476 answerable questions. agentmemory: published 500-question evaluation. Cook retrieves exchanges; agentmemory retrieves sessions. Scores measure finding relevant evidence, not whether the final answer is correct.
- 90.2Cook MemoryAnswer-bearing excerpts
- 88.2agentmemoryPublished · gold sessions
MRR rewards placing the first relevant result earlier: rank 1 contributes 1, rank 2 contributes 1/2. Shown ×100. Cook uses answer-bearing excerpts; agentmemory uses gold sessions. Published results from separate evaluation setups.
Finding the topic is only the beginning.
Combining keyword and semantic search, then ranking for the answer itself, lifted Cook’s top-five recall from 83.6% to 98.5% in the recorded evaluation.
Cite this paper
BibTeX for LaTeX and reference managers.
@techreport{worthington2026memory,
title = {{Cook Memory: Finding the Right Context Across Conversations}},
author = {Worthington, Austin},
year = {2026},
month = sep,
institution = {Client Acquisition.io},
type = {Technical Report},
url = {https://trycook.ai/research/memory}
}