rustio rustio.net
64

spider_worker

v2.48.8 Stable

The fastest web crawler as a worker or proxy.

MIT Edition 2021
Web programming #spider#crawler#spider_cli

Quick Verdict

  • โœ“Actively maintained (updated 2d ago)
  • โœ“Stable API (2.x for 3+ years)
  • โœ“Permissive license (MIT)

Security

Checking security advisories...
Downloads
1.6M
Dependents
0
Releases
1722
Size
37KB

Deep Insights

๐Ÿ“ˆ
Strong growth momentum

3.0K downloads in the last 30 days (101/day), up 121% from the previous period.

๐Ÿ‘ค
Prolific maintainer

The primary maintainer publishes 83 crates. This suggests deep Rust expertise and long-term commitment to the ecosystem.

โœ…
Stable for 3+ years

The API has been stable (1.x) for over 3 years with 1722 releases. This level of maturity means you can depend on it without worrying about breaking changes.

๐Ÿ“
Compact crate

At 36KB, spider_worker is lightweight. Small crate size correlates with focused, well-scoped functionality.

Health Breakdown

Maintenance 19/25

Recency, release consistency, active ratio

Quality 20/25

Yanked ratio, deps, size, maturity, features

Community 5/20

Reverse deps, ownership, ecosystem

Popularity 7/15

Downloads, momentum, growth trend

Documentation 13/15

Docs, repo, license, metadata

Download Trend

Daily downloads ยท last 90 days
72/day avg+56%
05001K2K12/291/162/32/213/113/28

Version Adoption

v1.83.11
20%
v1.83.4
20%
v1.83.5
20%
v1.82.4
20%
v1.83.6
20%

Release Timeline

1722 releases38 yankedsince 2023
J
F
M
A
M
J
J
A
S
O
N
D
2023
237
2024
652
2025
609
2026
224
Less
More|
Yanked

Feature Flags

tlscachescrapeheadersfull_resources

README

Loading README...

Maintainers

Dependencies
8
direct dependencies
Dependents
0
crates depend on spider_worker

Similar Crates