Decision Workspace
rust_scraper vs qrawl vs robotxt
Side-by-side comparison of Rust crates
43
rust_scraper
growingv1.0.0
Production-ready web scraper with Clean Architecture, TUI selector, and sitemap support
49
qrawl
growingv0.6.0
Rust toolkit to crawl web data for AI agents
48
robotxt
growingv0.6.1
The implementation of the Robots.txt (or URL exclusion) protocol with the support of crawl-delay, sitemap and universal match extensions.
Core Metrics
| rust_scraper | qrawl | robotxt | |
|---|---|---|---|
| Health Score | 43 | 49 | 48 |
| Total Downloads | 25 | 2.1K | 46.7K |
| 30d Downloads | 0 | 0 | 0 |
| Dependents | 0 | 0 | 71 |
| Releases | 1 | 10 | 14 |
| Last Updated | 214d ago | 147d ago | 946d ago |
| Age | 7m | 1y 1m | 3y 7m |
Health Breakdown
rust_scraper
Maintenance
4
Quality
16
Community
6
Popularity
2
Documentation
15
qrawl
Maintenance
12
Quality
12
Community
6
Popularity
4
Documentation
15
robotxt
Maintenance
6
Quality
12
Community
11
Popularity
6
Documentation
13
Technical Details
| rust_scraper | qrawl | robotxt | |
|---|---|---|---|
| Version | 1.0.0 | 0.6.0 | 0.6.1 |
| Stable (≥1.0) | ✓ Yes | ✗ No | ✗ No |
| License | MIT OR Apache-2.0 | MIT | MIT |
| Dependencies | 45 | 16 | 8 |
| Crate Size | 181KB | 68KB | 16KB |
| Features | 5 | 0 | 6 |
| Yanked % | 0.0% | 0.0% | 14.3% |
| Edition | 2021 | 2021 | 2021 |
| MSRV | 1.80 | 1.74 | — |
| Owners | 1 | 1 | 1 |
Links
Quick Verdict
- •qrawl leads with a health score of 49/100, but none of the options score above 80.
- •robotxt has the most downloads (46.7K), suggesting wider adoption.
- •⚠ robotxt has not been updated in over a year.
- •qrawl, robotxt are pre-1.0 — API may change.