hippo-memory 1.38.2 → 1.38.3
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
package/README.md
CHANGED
|
@@ -798,7 +798,7 @@ Different tools answer different questions. Mem0 and Basic Memory implement "sav
|
|
|
798
798
|
|
|
799
799
|
## Benchmarks
|
|
800
800
|
|
|
801
|
-
|
|
801
|
+
Three benchmarks testing three different things. Full details in [`benchmarks/`](benchmarks/).
|
|
802
802
|
|
|
803
803
|
### LongMemEval (retrieval accuracy)
|
|
804
804
|
|
|
@@ -847,6 +847,23 @@ python retrieve_fast.py --data data/longmemeval_oracle.json --store-dir ./store
|
|
|
847
847
|
python evaluate_retrieval.py --retrieval results/retrieval.jsonl --data data/longmemeval_oracle.json
|
|
848
848
|
```
|
|
849
849
|
|
|
850
|
+
### LoCoMo (conversational evidence recall)
|
|
851
|
+
|
|
852
|
+
[LoCoMo](https://arxiv.org/abs/2402.17753) is 10 long multi-session conversations (5,882 turns, 1,986 questions). Hippo scores it with a deterministic metric: did the gold evidence turn land in the top 5 recalled memories? No LLM judge is in the scoring path, so the numbers are not comparable to the LLM-as-judge accuracy Mem0 and Letta publish for LoCoMo.
|
|
853
|
+
|
|
854
|
+
**v1.25.0 baseline (measured 2026-07-05, single run).** Zero-dependency default embedder (`Xenova/all-MiniLM-L6-v2`), fresh store per conversation, `hippo recall --budget 4000`, top-k 5, 1,982 scored questions:
|
|
855
|
+
|
|
856
|
+
| Category | n | Evidence recall@5 |
|
|
857
|
+
|----------|--:|------------------:|
|
|
858
|
+
| single-hop | 282 | 0.239 |
|
|
859
|
+
| multi-hop | 321 | 0.491 |
|
|
860
|
+
| temporal-reasoning | 92 | 0.169 |
|
|
861
|
+
| open-domain | 841 | 0.450 |
|
|
862
|
+
| adversarial | 446 | 0.226 |
|
|
863
|
+
| **overall** | 1,982 | **0.363** |
|
|
864
|
+
|
|
865
|
+
Read these as a point estimate, not an exact value: n=1, and the run predates the v1.26.0 determinism fix and the harness fix in [#126](https://github.com/kitfunso/hippo-memory/pull/126) (0.9% of stored rows lost their tags at run time). The table has not been re-run on a newer build. Overall recall is 2.10x the April v0.32.0 baseline under the identical protocol. Informational only, gates no feature. Full protocol, caveats and regeneration commands: [`benchmarks/LOCOMO_INVESTIGATION.md`](benchmarks/LOCOMO_INVESTIGATION.md); harness in [`benchmarks/locomo/`](benchmarks/locomo/).
|
|
866
|
+
|
|
850
867
|
### Sequential Learning Benchmark (agent improvement over time)
|
|
851
868
|
|
|
852
869
|
No other public benchmark tests whether memory systems produce learning curves. LongMemEval tests retrieval on a fixed corpus. This benchmark tests whether an agent with memory *performs better on task 40 than task 5*.
|
package/dist/src/version.js
CHANGED
|
@@ -18,7 +18,7 @@
|
|
|
18
18
|
* an ESM `import` can resolve cleanly, and a hardcoded constant survives
|
|
19
19
|
* any packager that drops .json files.
|
|
20
20
|
*/
|
|
21
|
-
export const PACKAGE_VERSION = '1.38.
|
|
21
|
+
export const PACKAGE_VERSION = '1.38.3';
|
|
22
22
|
// Bump on every release alongside the 4 other manifests + lockfile.
|
|
23
23
|
/**
|
|
24
24
|
* Compare two semver strings. Returns positive if a > b, 0 if equal, negative
|
package/dist/version.d.ts
CHANGED
|
@@ -18,7 +18,7 @@
|
|
|
18
18
|
* an ESM `import` can resolve cleanly, and a hardcoded constant survives
|
|
19
19
|
* any packager that drops .json files.
|
|
20
20
|
*/
|
|
21
|
-
export declare const PACKAGE_VERSION = "1.38.
|
|
21
|
+
export declare const PACKAGE_VERSION = "1.38.3";
|
|
22
22
|
/**
|
|
23
23
|
* Compare two semver strings. Returns positive if a > b, 0 if equal, negative
|
|
24
24
|
* if a < b.
|
package/dist/version.js
CHANGED
|
@@ -18,7 +18,7 @@
|
|
|
18
18
|
* an ESM `import` can resolve cleanly, and a hardcoded constant survives
|
|
19
19
|
* any packager that drops .json files.
|
|
20
20
|
*/
|
|
21
|
-
export const PACKAGE_VERSION = '1.38.
|
|
21
|
+
export const PACKAGE_VERSION = '1.38.3';
|
|
22
22
|
// Bump on every release alongside the 4 other manifests + lockfile.
|
|
23
23
|
/**
|
|
24
24
|
* Compare two semver strings. Returns positive if a > b, 0 if equal, negative
|
package/openclaw.plugin.json
CHANGED
|
@@ -2,7 +2,7 @@
|
|
|
2
2
|
"id": "hippo-memory",
|
|
3
3
|
"name": "Hippo Memory",
|
|
4
4
|
"description": "Biologically-inspired memory for AI agents. Decay by default, retrieval strengthening, sleep consolidation.",
|
|
5
|
-
"version": "1.38.
|
|
5
|
+
"version": "1.38.3",
|
|
6
6
|
"configSchema": {
|
|
7
7
|
"type": "object",
|
|
8
8
|
"additionalProperties": false,
|