Decision Workspace
larc-benchmark vs mnem-bench vs hippmem-eval
Side-by-side comparison of Rust crates
38
larc-benchmark
experimentalv0.1.1
Domain-agnostic performance benchmark framework for knowledge retrieval systems
52
mnem-bench
experimentalv0.1.7
v1.0 benchmark harness for mnem - download, run, score LongMemEval / LoCoMo against the cpu-local adapter.
45
hippmem-eval
experimentalv0.4.5
Evaluation framework for HIPPMEM — corpus loading, benchmark execution, metric computation, threshold verification
Core Metrics
| larc-benchmark | mnem-bench | hippmem-eval | |
|---|---|---|---|
| Health Score | 38 | 52 | 45 |
| Total Downloads | 35 | 207 | 155 |
| 30d Downloads | 0 | 0 | 0 |
| Dependents | 0 | 4 | 0 |
| Releases | 2 | 4 | 9 |
| Last Updated | 121d ago | 141d ago | 43d ago |
| Age | 4m | 5m | 2m |
Health Breakdown
larc-benchmark
Maintenance
11
Quality
9
Community
6
Popularity
2
Documentation
10
mnem-bench
Maintenance
14
Quality
13
Community
7
Popularity
3
Documentation
15
hippmem-eval
Maintenance
10
Quality
12
Community
5
Popularity
3
Documentation
15
Technical Details
| larc-benchmark | mnem-bench | hippmem-eval | |
|---|---|---|---|
| Version | 0.1.1 | 0.1.7 | 0.4.5 |
| Stable (≥1.0) | ✗ No | ✗ No | ✗ No |
| License | Apache-2.0 | Apache-2.0 | AGPL-3.0-only |
| Dependencies | 4 | 16 | 8 |
| Crate Size | 5KB | 58KB | 98KB |
| Features | 2 | 2 | 0 |
| Yanked % | 50.0% | 0.0% | 0.0% |
| Edition | 2024 | 2024 | 2021 |
| MSRV | — | 1.95 | 1.95 |
| Owners | 1 | 1 | 1 |
Links
Quick Verdict
- •mnem-bench leads with a health score of 52/100, but none of the options score above 80.