Decision Workspace
evalframe vs eval-core vs swink-agent-eval
Side-by-side comparison of Rust crates
36
evalframe
experimentalv0.3.0
Standalone eval framework for LLM outputs — Lua DSL with Rust host
54
eval-core
experimentalv0.4.0
A testing framework for LLM agents: prompt-based test cases with built-in assertions on tool calls, parameters, and text/math output — bring your own harness.
52
swink-agent-eval
experimentalv0.14.3
Evaluation framework for swink-agent: trajectory tracing, golden path verification, and cost governance
Core Metrics
| evalframe | eval-core | swink-agent-eval | |
|---|---|---|---|
| Health Score | 36 | 54 | 52 |
| Total Downloads | 31 | 236 | 376 |
| 30d Downloads | 0 | 0 | 0 |
| Dependents | 0 | 0 | 0 |
| Releases | 1 | 4 | 19 |
| Last Updated | 206d ago | 110d ago | 19d ago |
| Age | 6m | 3m | 5m |
Health Breakdown
evalframe
Maintenance
5
Quality
13
Community
6
Popularity
2
Documentation
10
eval-core
Maintenance
18
Quality
12
Community
6
Popularity
3
Documentation
15
swink-agent-eval
Maintenance
18
Quality
13
Community
6
Popularity
3
Documentation
12
Technical Details
| evalframe | eval-core | swink-agent-eval | |
|---|---|---|---|
| Version | 0.3.0 | 0.4.0 | 0.14.3 |
| Stable (≥1.0) | ✗ No | ✗ No | ✗ No |
| License | MIT | MIT OR Apache-2.0 | MIT |
| Dependencies | 5 | 11 | 32 |
| Crate Size | 45KB | 81KB | 291KB |
| Features | 0 | 0 | 25 |
| Yanked % | 0.0% | 0.0% | 0.0% |
| Edition | 2021 | 2024 | 2024 |
| MSRV | — | 1.88 | 1.95 |
| Owners | 1 | 1 | 1 |
Links
Quick Verdict
- •eval-core leads with a health score of 54/100, but none of the options score above 80.
- •swink-agent-eval has the most downloads (376), suggesting wider adoption.