Decision Workspace
fast-robots vs robotstxt-rs vs susbot-core
Side-by-side comparison of Rust crates
51
fast-robots
experimentalv0.1.5
A zero-copy robots.txt parser with SIMD-accelerated byte scanning.
53
robotstxt-rs
growingv0.1.4
An intuitive Rust library for aquiring, parsing and querying robots.txt files.
47
susbot-core
experimentalv2.2.1
robots.txt analysis engine: parser, RFC 9309 matcher, lint checks, security and reconnaissance findings, exports
Core Metrics
| fast-robots | robotstxt-rs | susbot-core | |
|---|---|---|---|
| Health Score | 51 | 53 | 47 |
| Total Downloads | 329 | 1.6K | 107 |
| 30d Downloads | 0 | 0 | 0 |
| Dependents | 0 | 0 | 5 |
| Releases | 6 | 5 | 5 |
| Last Updated | 106d ago | 373d ago | 16d ago |
| Age | 5m | 1y | 20d |
Health Breakdown
fast-robots
Maintenance
14
Quality
13
Community
6
Popularity
3
Documentation
15
robotstxt-rs
Maintenance
13
Quality
17
Community
6
Popularity
4
Documentation
13
susbot-core
Maintenance
15
Quality
14
Community
8
Popularity
2
Documentation
8
Technical Details
| fast-robots | robotstxt-rs | susbot-core | |
|---|---|---|---|
| Version | 0.1.5 | 0.1.4 | 2.2.1 |
| Stable (≥1.0) | ✗ No | ✗ No | ✓ Yes |
| License | MIT OR Apache-2.0 | MIT | PolyForm-Noncommercial-1.0.0 |
| Dependencies | 9 | 3 | 8 |
| Crate Size | 385KB | 18KB | 95KB |
| Features | 2 | 2 | 0 |
| Yanked % | 0.0% | 0.0% | 0.0% |
| Edition | 2024 | 2021 | 2021 |
| MSRV | 1.86 | — | — |
| Owners | 1 | 1 | 1 |
Links
Quick Verdict
- •robotstxt-rs leads with a health score of 53/100, but none of the options score above 80.
- •⚠ robotstxt-rs has not been updated in over a year.
- •fast-robots, robotstxt-rs are pre-1.0 — API may change.