Decision Workspace
mcptest-scorer-core vs mcptest-agent vs eval-core
Side-by-side comparison of Rust crates
52
mcptest-scorer-core
experimentalv1.3.0
Scorer adapter trait, registry, and shared substrate for mcptest evals
54
mcptest-agent
experimentalv1.3.0
Agent E2E test driver: connects an LLM to an MCP server and records the conversation trace.
54
eval-core
experimentalv0.4.0
A testing framework for LLM agents: prompt-based test cases with built-in assertions on tool calls, parameters, and text/math output — bring your own harness.
Core Metrics
| mcptest-scorer-core | mcptest-agent | eval-core | |
|---|---|---|---|
| Health Score | 52 | 54 | 54 |
| Total Downloads | 248 | 256 | 236 |
| 30d Downloads | 0 | 0 | 0 |
| Dependents | 5 | 5 | 0 |
| Releases | 5 | 5 | 4 |
| Last Updated | 73d ago | 73d ago | 110d ago |
| Age | 4m | 4m | 3m |
Health Breakdown
mcptest-scorer-core
Maintenance
15
Quality
15
Community
7
Popularity
3
Documentation
12
mcptest-agent
Maintenance
15
Quality
17
Community
7
Popularity
3
Documentation
12
eval-core
Maintenance
18
Quality
12
Community
6
Popularity
3
Documentation
15
Technical Details
| mcptest-scorer-core | mcptest-agent | eval-core | |
|---|---|---|---|
| Version | 1.3.0 | 1.3.0 | 0.4.0 |
| Stable (≥1.0) | ✓ Yes | ✓ Yes | ✗ No |
| License | Apache-2.0 | Apache-2.0 | MIT OR Apache-2.0 |
| Dependencies | 8 | 10 | 11 |
| Crate Size | 23KB | 82KB | 81KB |
| Features | 0 | 2 | 0 |
| Yanked % | 0.0% | 0.0% | 0.0% |
| Edition | 2021 | 2021 | 2024 |
| MSRV | 1.85 | 1.85 | 1.88 |
| Owners | 1 | 1 | 1 |
Links
Quick Verdict
- •mcptest-agent leads with a health score of 54/100, but none of the options score above 80.
- •eval-core is pre-1.0 — API may change.