robotxt
v0.6.1 GrowingThe implementation of the Robots.txt (or URL exclusion) protocol with the support of crawl-delay, sitemap and universal match extensions.
Quick Verdict
- ✕Not updated for 2+ years
- !Pre-1.0: API may have breaking changes
- ✓Permissive license (MIT)
Security
Deep Insights
4.2K downloads in the last 30 days (140/day). Volume is roughly flat compared to the previous period.
Despite being 3+ years old, robotxt hasn't reached 1.0 yet. Expect potential API changes between versions.
At 16KB, robotxt is lightweight. Small crate size correlates with focused, well-scoped functionality.
14% of releases have been yanked. Check version history before pinning.
Health Breakdown
Recency, release consistency, active ratio
Yanked ratio, deps, size, maturity, features
Reverse deps, ownership, ecosystem
Downloads, momentum, growth trend
Docs, repo, license, metadata
Download Trend
Top Dependents
Most downloaded crates that depend on robotxt
Version Adoption
Release Timeline
Feature Flags
default =["builder", "parser"]
