Decision Workspace
robotstxt vs robotstxt-rs vs robotstxt-with-cache
Side-by-side comparison of Rust crates
41
robotstxt
growingv0.3.0
A native Rust port of Google's robots.txt parser and matcher C++ library.
53
robotstxt-rs
growingv0.1.4
An intuitive Rust library for aquiring, parsing and querying robots.txt files.
42
robotstxt-with-cache
growingv0.4.0
A native Rust port of Google's robots.txt parser and matcher C++ library.
Core Metrics
| robotstxt | robotstxt-rs | robotstxt-with-cache | |
|---|---|---|---|
| Health Score | 41 | 53 | 42 |
| Total Downloads | 612.9K | 1.6K | 6.5K |
| 30d Downloads | 0 | 0 | 0 |
| Dependents | 112 | 0 | 64 |
| Releases | 3 | 5 | 1 |
| Last Updated | 2065d ago | 373d ago | 1952d ago |
| Age | 7y 5m | 1y | 5y 4m |
Health Breakdown
robotstxt
Maintenance
3
Quality
10
Community
12
Popularity
7
Documentation
9
robotstxt-rs
Maintenance
13
Quality
17
Community
6
Popularity
4
Documentation
13
robotstxt-with-cache
Maintenance
1
Quality
16
Community
11
Popularity
5
Documentation
9
Technical Details
| robotstxt | robotstxt-rs | robotstxt-with-cache | |
|---|---|---|---|
| Version | 0.3.0 | 0.1.4 | 0.4.0 |
| Stable (≥1.0) | ✗ No | ✗ No | ✗ No |
| License | Apache-2.0 | MIT | Apache-2.0 |
| Dependencies | 0 | 3 | 0 |
| Crate Size | 18KB | 18KB | 19KB |
| Features | 0 | 2 | 0 |
| Yanked % | 33.3% | 0.0% | 0.0% |
| Edition | 2018 | 2021 | 2018 |
| MSRV | — | — | — |
| Owners | 1 | 1 | 1 |
Links
Quick Verdict
- •robotstxt-rs leads with a health score of 53/100, but none of the options score above 80.
- •robotstxt has the most downloads (612.9K), suggesting wider adoption.
- •robotstxt is depended on by 112 crates — strongest ecosystem trust.
- •⚠ robotstxt, robotstxt-rs, robotstxt-with-cache have not been updated in over a year.