rustio rustio.net
66

spider_cli

v2.51.197 Stable

The fastest web crawler CLI written in Rust.

MIT Edition 2021
Command line utilitiesWeb programming #spider#crawler#spider_cli

Quick Verdict

  • โœ“Actively maintained (updated 4d ago)
  • โœ“Stable API (2.x for 4+ years)
  • โœ“Permissive license (MIT)

Security

Checking security advisories...
Downloads
1.8M
Dependents
0
Releases
2120
Size
45KB

Deep Insights

๐Ÿ“‰
Download decline

1.4K downloads in the last 30 days, down 42% from the previous period. May indicate migration to alternatives.

๐Ÿ‘ค
Prolific maintainer

The primary maintainer publishes 98 crates. This suggests deep Rust expertise and long-term commitment to the ecosystem.

โœ…
Stable for 4+ years

The API has been stable (1.x) for over 4 years with 2120 releases. This level of maturity means you can depend on it without worrying about breaking changes.

๐Ÿ“
Compact crate

At 44KB, spider_cli is lightweight. Small crate size correlates with focused, well-scoped functionality.

Health Breakdown

Maintenance 19/25

Recency, release consistency, active ratio

Quality 21/25

Yanked ratio, deps, size, maturity, features

Community 6/20

Reverse deps, ownership, ecosystem

Popularity 7/15

Downloads, momentum, growth trend

Documentation 13/15

Docs, repo, license, metadata

Download Trend

Daily downloads ยท last 90 days
78/day avg-69%
05001K2K2K2/263/164/34/215/95/26

Version Adoption

v2.51.192
27%
v2.51.190
26%
v2.51.197
23%
v2.51.191
14%
v2.51.194
10%

Release Timeline

10 releasessince 2026
J
F
M
A
M
J
J
A
S
O
N
D
2026
10
Less
More

Feature Flags

default =["status_code", "chrome", "warc", "spider_cloud"]

timewarc*regexsmartchrome*headersjemallocmimallocremote_addrstatus_code*spider_cloud*chrome_intercept

README

Loading README...

Maintainers

Dependencies
12
direct dependencies
Dependents
0
crates depend on spider_cli

Similar Crates