50
crw-crawl
v0.1.2 ExperimentalAsync BFS web crawler with rate limiting and robots.txt support for CRW
AGPL-3.0 Edition 2024
Quick Verdict
- ✓Actively maintained (updated 0d ago)
- !Pre-1.0: API may have breaking changes
Security
Checking security advisories...
Downloads
273
Dependents
24
Releases
14
Size
43KB
Deep Insights
📊
Download activity
279 downloads in the last 30 days (9/day avg).
📐
Compact crate
At 42KB, crw-crawl is lightweight. Small crate size correlates with focused, well-scoped functionality.
Health Breakdown
Maintenance 13/25
Recency, release consistency, active ratio
Quality 14/25
Yanked ratio, deps, size, maturity, features
Community 10/20
Reverse deps, ownership, ecosystem
Popularity 3/15
Downloads, momentum, growth trend
Documentation 10/15
Docs, repo, license, metadata
Download Trend
Daily downloads · last 90 days
3/day avg
Top Dependents
Most downloaded crates that depend on crw-crawl
Version Adoption
v0.0.12
26%
v0.0.1
21%
v0.0.6
18%
v0.0.2
18%
v0.0.10
18%
Release Timeline
14 releasessince 2026
J
F
M
A
M
J
J
A
S
O
N
D
2026
14
LessMore
Feature Flags
default =["pdf"]
pdf*
README
Loading README...
Maintainers
Dependencies
13
direct dependencies
Dependents
24
crates depend on crw-crawl