rustio rustio.net
68

crawlberg

v1.10.3 Experimental

High-performance web crawling engine

MIT Edition 2024 MSRV 1.91
Network programmingWeb programming #web#rust#spider#scrape#crawl

Quick Verdict

  • โœ“Actively maintained (updated 1d ago)
  • โœ“Trusted by 235 crates
  • !Heavy dependency tree (84 direct deps)
  • โœ“Permissive license (MIT)

Security

Checking security advisories...
Downloads
42.6K
Dependents
235
Releases
41
Size
1.1MB

Deep Insights

๐Ÿ“ˆ
Strong growth momentum

15.6K downloads in the last 30 days (521/day), up 38% from the previous period.

๐Ÿ”—
Moderate adoption

235 crates depend on crawlberg. Reasonable ecosystem adoption, though not yet a core dependency.

๐Ÿ‘ค
Prolific maintainer

The primary maintainer publishes 105 crates. This suggests deep Rust expertise and long-term commitment to the ecosystem.

๐Ÿ“ฆ
Heavy dependency tree

84 direct dependencies. Consider the impact on compile times and supply chain complexity.

๐ŸŒŸ
Used by top crates

Notable dependents include xberg, daedra, crawlberg-bypass, basemind, crawlberg-cli. When high-quality crates choose crawlberg, it's a strong quality signal.

Health Breakdown

Maintenance 20/25

Recency, release consistency, active ratio

Quality 15/25

Yanked ratio, deps, size, maturity, features

Community 12/20

Reverse deps, ownership, ecosystem

Popularity 6/15

Downloads, momentum, growth trend

Documentation 15/15

Docs, repo, license, metadata

Download Trend

Daily downloads ยท last 90 days
54/day avg-100%
02004006008008/229/99/2710/1511/211/19

Top Dependents

Version Adoption

v1.7.1
53%
v1.8.0
27%
v1.6.4
10%
v1.10.2
5%
v1.10.3
4%

Release Timeline

10 releasessince 2026
J
F
M
A
M
J
J
A
S
O
N
D
2026
10
Less
More

Feature Flags

default =["native-runtime"]

aiapimcpfullotelwarcbrowserinteractmcp-httpbrowser-nativenative-runtime*browser-chromiumoxide

README

Loading README...

Maintainers

Dependencies
84
direct dependencies
Dependents
235
crates depend on crawlberg

Similar Crates