Decision Workspace
aether-evals vs eval-core vs swink-agent-eval
Side-by-side comparison of Rust crates
56
aether-evals
experimentalv0.3.19
Dockerized eval harness for Aether AI agents
54
eval-core
experimentalv0.4.0
A testing framework for LLM agents: prompt-based test cases with built-in assertions on tool calls, parameters, and text/math output — bring your own harness.
52
swink-agent-eval
experimentalv0.14.3
Evaluation framework for swink-agent: trajectory tracing, golden path verification, and cost governance
Core Metrics
| aether-evals | eval-core | swink-agent-eval | |
|---|---|---|---|
| Health Score | 56 | 54 | 52 |
| Total Downloads | 1.5K | 236 | 376 |
| 30d Downloads | 0 | 0 | 0 |
| Dependents | 51 | 0 | 0 |
| Releases | 50 | 4 | 19 |
| Last Updated | 1d ago | 110d ago | 19d ago |
| Age | 4m | 3m | 5m |
Health Breakdown
aether-evals
Maintenance
20
Quality
12
Community
10
Popularity
4
Documentation
10
eval-core
Maintenance
18
Quality
12
Community
6
Popularity
3
Documentation
15
swink-agent-eval
Maintenance
18
Quality
13
Community
6
Popularity
3
Documentation
12
Technical Details
| aether-evals | eval-core | swink-agent-eval | |
|---|---|---|---|
| Version | 0.3.19 | 0.4.0 | 0.14.3 |
| Stable (≥1.0) | ✗ No | ✗ No | ✗ No |
| License | MIT | MIT OR Apache-2.0 | MIT |
| Dependencies | 12 | 11 | 32 |
| Crate Size | 54KB | 81KB | 291KB |
| Features | 0 | 0 | 25 |
| Yanked % | 0.0% | 0.0% | 0.0% |
| Edition | 2024 | 2024 | 2024 |
| MSRV | — | 1.88 | 1.95 |
| Owners | 1 | 1 | 1 |
Links
Quick Verdict
- •aether-evals leads with a health score of 56/100, but none of the options score above 80.