rustio rustio.net
65

spider_cli

v2.52.9 Stable

The fastest web crawler CLI written in Rust.

MIT Edition 2021
Command line utilitiesWeb programming #spider#crawler#spider_cli

Quick Verdict

  • โœ“Actively maintained (updated 5d ago)
  • โœ“Stable API (2.x for 4+ years)
  • โœ“Permissive license (MIT)

Security

Checking security advisories...
Downloads
1.8M
Dependents
0
Releases
2139
Size
49KB

Deep Insights

๐Ÿ“ˆ
Strong growth momentum

4.6K downloads in the last 30 days (152/day), up 744% from the previous period.

๐Ÿ‘ค
Prolific maintainer

The primary maintainer publishes 98 crates. This suggests deep Rust expertise and long-term commitment to the ecosystem.

โœ…
Stable for 4+ years

The API has been stable (1.x) for over 4 years with 2139 releases. This level of maturity means you can depend on it without worrying about breaking changes.

๐Ÿ“
Compact crate

At 48KB, spider_cli is lightweight. Small crate size correlates with focused, well-scoped functionality.

Health Breakdown

Maintenance 19/25

Recency, release consistency, active ratio

Quality 20/25

Yanked ratio, deps, size, maturity, features

Community 6/20

Reverse deps, ownership, ecosystem

Popularity 7/15

Downloads, momentum, growth trend

Documentation 13/15

Docs, repo, license, metadata

Download Trend

Daily downloads ยท last 90 days
69/day avg+78%
05001K2K2K4/265/146/16/197/77/24

Version Adoption

v2.51.208
33%
v2.52.4
24%
v2.52.9
19%
v2.52.1
13%
v2.52.7
12%

Release Timeline

10 releasessince 2026
J
F
M
A
M
J
J
A
S
O
N
D
2026
10
Less
More

Feature Flags

default =["status_code", "chrome", "warc", "spider_cloud"]

timewarc*regexsmartchrome*headersjemallocmimallocremote_addrstatus_code*spider_cloud*chrome_intercept

README

Loading README...

Maintainers

Dependencies
16
direct dependencies
Dependents
0
crates depend on spider_cli

Similar Crates