Decision Workspace
dev-flaky vs sooth vs nornir-testmatrix
Side-by-side comparison of Rust crates
59
dev-flaky
experimentalv0.9.2
Flaky test detection for Rust. Runs cargo test N times and classifies each test as stable / flaky / broken with a reliability score in [0.0, 1.0]. Part of the dev-* verification collection.
40
sooth
experimentalv0.1.0
The truth about your tests — a local test-suite observer that finds flaky, slow, and order-dependent tests. Work in progress.
64
nornir-testmatrix
experimentalv0.2.14
Reusable, multi-aspect Rust test-matrix engine: wrap a repo's native cargo test/nextest plus build/clippy/fmt/audit/coverage/doctest aspects, parse the results into rows, and ship them to any TestSink. Pure std + serde — no iceberg, arrow, eframe. The portable core of nornir's `nornir test` matrix.
Core Metrics
| dev-flaky | sooth | nornir-testmatrix | |
|---|---|---|---|
| Health Score | 59 | 40 | 64 |
| Total Downloads | 148 | 37 | 11.1K |
| 30d Downloads | 0 | 0 | 0 |
| Dependents | 7 | 0 | 720 |
| Releases | 4 | 2 | 21 |
| Last Updated | 1d ago | 86d ago | today |
| Age | 5m | 3m | 3m |
Health Breakdown
dev-flaky
Maintenance
18
Quality
15
Community
8
Popularity
3
Documentation
15
sooth
Maintenance
12
Quality
8
Community
6
Popularity
2
Documentation
12
nornir-testmatrix
Maintenance
19
Quality
14
Community
14
Popularity
5
Documentation
12
Technical Details
| dev-flaky | sooth | nornir-testmatrix | |
|---|---|---|---|
| Version | 0.9.2 | 0.1.0 | 0.2.14 |
| Stable (≥1.0) | ✗ No | ✗ No | ✗ No |
| License | Apache-2.0 | MIT OR Apache-2.0 | MIT OR Apache-2.0 |
| Dependencies | 3 | 2 | 5 |
| Crate Size | 37KB | 49KB | 302KB |
| Features | 1 | 0 | 2 |
| Yanked % | 0.0% | 50.0% | 0.0% |
| Edition | 2021 | 2021 | 2024 |
| MSRV | 1.75 | 1.80 | 1.85 |
| Owners | 1 | 1 | 1 |
Links
Quick Verdict
- •nornir-testmatrix leads with a health score of 64/100, but none of the options score above 80.
- •nornir-testmatrix is depended on by 720 crates — strongest ecosystem trust.