C30 Updated 2026-06-20
Pillar 3 - Evaluating and Choosing Memory

How to Evaluate RAG and Agent-Memory Accuracy

Build a golden set over your own data, inspect retrieval evidence, and score agent memory without relying on borrowed benchmark numbers.

Evaluate RAG and agent-memory accuracy with a golden set over your own sources. Write questions with known answers, log what the retriever returned, inspect the source evidence, and score whether the final answer is supported. Do not borrow a vendor number from a different dataset.

Last updated: June 20, 2026.

Why not use a public benchmark number?

Public benchmark numbers can be useful for research, but buying decisions need your sources, your permissions, and your failure modes. A memory layer that performs well on a public task may still fail when a source is stale, a ticket is permission-bound, or the correct answer requires a superseded policy to be ignored.

OpenAI’s evals guide recommends defining the task, running test inputs, and analyzing results before iterating (OpenAI evals guide). Its evaluation best-practices guide also distinguishes generic model benchmarks from tests you design for your own LLM application (OpenAI evaluation best practices).

Agent memory needs that application-specific approach.

What should your golden set contain?

A useful golden set is small, concrete, and source-backed. Start with questions your team can judge by looking at the source material.

Case typeExampleWhy it matters
Direct source answer”What is the current API retry policy?”Tests whether retrieval finds the right source.
Changed fact”What is the current launch date?”Tests supersession or stale-source handling.
Permission boundary”Show customer renewal notes for Account A.”Tests tenant and source scope.
Abstention”What was the board decision on an undocumented plan?”Tests whether the agent refuses unsupported answers.
Multi-source synthesis”What changed between the ticket and the launch doc?”Tests source joining and citation behavior.
Deletion/correction”Does this removed memory still appear?”Tests lifecycle controls.

Do not make the set too broad at first. A small set that engineers actually inspect is more useful than a large spreadsheet nobody trusts.

What should you log?

Log the retrieval path, not just the final answer. Without retrieval logs, you cannot tell whether a bad answer came from missing source data, weak search, bad ranking, scope filters, or generation.

Capture:

  • Query text and user/workspace scope.
  • Candidate source IDs and ranks.
  • Returned summaries or snippets.
  • Current or superseded state.
  • Final answer and citations.
  • Latency and tool/client surface.
  • Human score and notes.

This is where agent-memory evaluation differs from generic chatbot evaluation. The evidence path matters as much as the answer text.

How should you score answers?

Keep the rubric simple:

ScoreMeaning
SupportedThe answer is fully supported by retrieved source evidence.
Partially supportedThe answer is directionally right but misses source detail or caveats.
UnsupportedThe answer makes claims not present in returned evidence.
StaleThe answer uses older evidence when a newer source exists.
Scoped outThe answer should not be available to this user or tenant.
Abstained correctlyThe agent said it lacked evidence when sources were insufficient.

You can turn this into numeric metrics later. For launch evaluation, the categorical labels are easier to review and harder to overclaim.

Where does Answer Engine fit?

Answer Engine should frame retrieval logs and scorecards as the proof mechanism, not publish a premature number. Roadmap: the public Answer Engine number ships only after the gated scorecard and retrieval instrumentation are complete.

Until then, the honest claim is methodological: use source-aware memory, inspect returned evidence, and run a golden set over your own data. That is stronger than an unsupported marketing number.

How do you run the first evaluation?

  1. Pick one source set, such as product docs and tickets.
  2. Write a golden set with direct, stale, permission, abstention, and multi-source cases.
  3. Run each question through the memory layer.
  4. Save returned source IDs, ranks, and summaries.
  5. Score the answer with the rubric above.
  6. Fix the first failure class before expanding the set.

The first run will probably reveal source gaps or retrieval misses. That is the point. Evaluation is not a launch badge; it is the operating loop for making memory trustworthy.

Read Why agents recommend stale or outdated information for retrieval failure modes, Agent Memory: The Complete Guide for memory architecture, and the comparison hub for product-fit columns to include in procurement.

Sources

Fig. 9 FAQPage schema / visible answers
FIG. 9

FAQ

How should teams evaluate agent-memory accuracy?

Use a small golden set over your own sources, inspect retrieved evidence, and score whether the answer is supported by the returned context.

Does Answer Engine publish an accuracy number here?

No. The public number is roadmap-gated until the retrieval log, reranker, and reproducible scorecard work are complete.

What should a memory eval include?

Include source-backed questions, changed-fact questions, permission-boundary checks, abstention cases, and deletion or correction checks.

NEXT

Build memory you can inspect.

Answer Engine gives agents a persistent, tenant-isolated memory layer via MCP, with source-aware recall and roadmap-labeled inspection work.