rustio rustio.net
66

spider_cli

v2.48.8 Stable

The fastest web crawler CLI written in Rust.

MIT Edition 2021
Command line utilitiesWeb programming #spider#crawler#spider_cli

Quick Verdict

  • โœ“Actively maintained (updated 2d ago)
  • โœ“Stable API (2.x for 3+ years)
  • โœ“Permissive license (MIT)

Security

Checking security advisories...
Downloads
1.8M
Dependents
0
Releases
1884
Size
43KB

Deep Insights

๐Ÿ“ˆ
Strong growth momentum

3.3K downloads in the last 30 days (109/day), up 134% from the previous period.

๐Ÿ‘ค
Prolific maintainer

The primary maintainer publishes 83 crates. This suggests deep Rust expertise and long-term commitment to the ecosystem.

โœ…
Stable for 3+ years

The API has been stable (1.x) for over 3 years with 1884 releases. This level of maturity means you can depend on it without worrying about breaking changes.

๐Ÿ“
Compact crate

At 42KB, spider_cli is lightweight. Small crate size correlates with focused, well-scoped functionality.

Health Breakdown

Maintenance 19/25

Recency, release consistency, active ratio

Quality 21/25

Yanked ratio, deps, size, maturity, features

Community 6/20

Reverse deps, ownership, ecosystem

Popularity 7/15

Downloads, momentum, growth trend

Documentation 13/15

Docs, repo, license, metadata

Download Trend

Daily downloads ยท last 90 days
77/day avg+54%
05001K2K2K12/291/162/32/213/113/28

Version Adoption

v1.84.0
20%
v1.83.0
20%
v1.83.6
20%
v1.84.7
20%
v1.83.4
20%

Release Timeline

1884 releases45 yankedsince 2022
J
F
M
A
M
J
J
A
S
O
N
D
2022
81
2023
319
2024
650
2025
610
2026
224
Less
More|
Yanked

Feature Flags

default =["status_code", "chrome", "warc"]

timewarc*regexsmartchrome*headersjemallocremote_addrstatus_code*chrome_intercept

README

Loading README...

Maintainers

Dependencies
11
direct dependencies
Dependents
0
crates depend on spider_cli

Similar Crates