rustio rustio.net
42

website_crawler

v0.9.9 Growing

gRPC tokio based web crawler built with spider

MIT Edition 2021
AsynchronousAccessibility #spider#crawler#site-map-generator#web-crawler#web-indexer

Quick Verdict

  • โœ•Not updated for 1+ year
  • !Pre-1.0: API may have breaking changes
  • โœ“Permissive license (MIT)

Security

Checking security advisories...
Downloads
240.6K
Dependents
0
Releases
203
Size
29KB

Deep Insights

๐Ÿ“ˆ
Strong growth momentum

269 downloads in the last 30 days (9/day), up 1482% from the previous period.

๐Ÿ‘ค
Prolific maintainer

The primary maintainer publishes 83 crates. This suggests deep Rust expertise and long-term commitment to the ecosystem.

๐Ÿ”ฌ
Pre-1.0 for over a year

Despite being 5+ years old, website_crawler hasn't reached 1.0 yet. Expect potential API changes between versions.

๐Ÿ“
Compact crate

At 28KB, website_crawler is lightweight. Small crate size correlates with focused, well-scoped functionality.

Health Breakdown

Maintenance 7/25

Recency, release consistency, active ratio

Quality 13/25

Yanked ratio, deps, size, maturity, features

Community 6/20

Reverse deps, ownership, ecosystem

Popularity 6/15

Downloads, momentum, growth trend

Documentation 10/15

Docs, repo, license, metadata

Download Trend

Daily downloads ยท last 90 days
6/day avg+9%
05010015020012/291/162/32/213/113/28

Version Adoption

v0.9.2
25%
v0.9.9
19%
v0.8.12
19%
v0.8.7
19%
v0.9.6
18%

Release Timeline

203 releases8 yankedsince 2021
J
F
M
A
M
J
J
A
S
O
N
D
2021
3
2022
94
2023
96
2024
10
2025
2026
Less
More|
Yanked

Feature Flags

regexsmartchromejemalloc

README

Loading README...

Maintainers

Dependencies
17
direct dependencies
Dependents
0
crates depend on website_crawler

Similar Crates