Vercy · research
Research.
What structured memory does for an agent, measured rather than asserted. Negative results stay on the page.
2026-09-06
Personal Dimension Benchmark
- Question
- For one person's own records, what does the representation do for the assistant reading them, and which part of a structured representation carries which capability?
- Finding
- Structure did not beat complete notes: chronological notes carrying every fact, date and source scored 93.4% against 100% for a structured dimension, three items apart, p = 0.25. Every ablation was decisive. Without validity intervals, historical accuracy fell from 100% to 0% and expiry judgement to 20%, with current-state questions untouched. Without provenance, conflict resolution fell from 100% to 33%. Each field class is the sole support of one capability.
2026-09-06
Semantic Grounding Benchmark
- Question
- Does a versioned definition layer make an agent more accurate when two organisations define the same words differently?
- Finding
- No. Continuous prose carrying the same facts matched versioned records exactly, 76.5% against 76.5%, p = 1.00: accuracy follows completeness, not representation. The structured conditions were the only ones that cited the rule applied, located a missing definition and its owner, routed a request to the right owner, and made 72 disclosure decisions without a critical error.
2026-08
Memory retrieval
- Question
- Does retrieval over a structured dimension beat flat notes on recall of a project's own history?
- Finding
- Parity on accuracy: all 15 questions answered correctly under both conditions across three fresh runs. Retrieval supplied 57.9% less context. The result is a tie, and is published as one.
How these are published
Every study here ships the instrument that produced it, the unedited raw runs of every model call, and the record of any review that invalidated an earlier version. Where a claim did not survive the data, the claim was changed and the data was not. A benchmark whose failures are not published is a marketing artefact rather than a measurement.