Skip to content

Commit 0cf5ea1

Browse files
committed
docs(readme): de-stale LoCoMo label without faking a v2.2 number
Drop the 'v1.7' version pin from the table row and add an honest footnote: the figures were measured on the v1.7 engine and have NOT been re-run on v2.2, so they're reported as the last verified numbers, not a v2.2 claim. Also documented the re-run prerequisites (ANTHROPIC_API_KEY + Ollama nomic-embed-text).
1 parent b9d7b96 commit 0cf5ea1

1 file changed

Lines changed: 2 additions & 2 deletions

File tree

README.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -96,7 +96,7 @@ Academic-grade long-term conversation memory evaluation — 10 conversations, 15
9696
|--------|-----------|-----------|-------------|----------|---------|
9797
| Backboard | 89.4% | 75.0% | 91.2% | 91.9% | 90.0% |
9898
| MemMachine v0.2 ||||| 84.9% |
99-
| **Cortex v1.7** | **72.5%** | **59.5%** | **88.8%** | **74.1%** | **73.7%** |
99+
| **Cortex** | **72.5%** | **59.5%** | **88.8%** | **74.1%** | **73.7%** |
100100
| Mem0-Graph | 65.7% | 47.2% | 75.7% | 58.1% | 68.4% |
101101
| Mem0 | 67.1% | 51.2% | 72.9% | 55.5% | 66.9% |
102102
| OpenAI Memory ||||| 52.9% |
@@ -110,7 +110,7 @@ Academic-grade long-term conversation memory evaluation — 10 conversations, 15
110110

111111
Cortex outperforms Mem0 on all 4 categories — while running 100% locally, end-to-end encrypted, at $0 cost.
112112

113-
> **Setup:** Claude Sonnet 4 (QA + judge), nomic-embed-text (embeddings via Ollama), top-30 retrieval. Fully reproducible: `python3 bench/locomo_bench.py`
113+
> **Setup:** Claude Sonnet 4 (QA + judge), nomic-embed-text (embeddings via Ollama), top-30 retrieval. Reproducible with that setup: `python3 bench/locomo_bench.py` (needs `ANTHROPIC_API_KEY` + a local Ollama with `nomic-embed-text`). Numbers measured on the v1.7 engine; the v2.2 retrieval beam fix (paraphrase recall 40%→90% at 5K, see `docs/scale-test-2026-06-13.md`) has not yet been re-run on LoCoMo, so these are reported as the last verified figures, not a v2.2 claim.
114114
115115
## Architecture
116116

0 commit comments

Comments
 (0)