47
wordchipper
v0.9.0 ExperimentalHPC Rust LLM Tokenizer Library
MIT Edition 2024 MSRV 1.93.0
#ai#tokenizer#gpt#bpe
Quick Verdict
- ✓Actively maintained (updated 4d ago)
- !Pre-1.0: API may have breaking changes
- !Heavy dependency tree (28 direct deps)
- ✓Permissive license (MIT)
Security
Checking security advisories...
Downloads
442
Dependents
8
Releases
27
Size
259KB
Deep Insights
📉
Download decline
128 downloads in the last 30 days, down 60% from the previous period. May indicate migration to alternatives.
📦
Heavy dependency tree
28 direct dependencies. Consider the impact on compile times and supply chain complexity.
🌟
Used by top crates
Notable dependents include wordchipper-training, wordchipper-cli-util, wordchipper-cli, wchipper. When high-quality crates choose wordchipper, it's a strong quality signal.
Health Breakdown
Maintenance 13/25
Recency, release consistency, active ratio
Quality 13/25
Yanked ratio, deps, size, maturity, features
Community 6/20
Reverse deps, ownership, ecosystem
Popularity 3/15
Downloads, momentum, growth trend
Documentation 12/15
Docs, repo, license, metadata
Download Trend
Daily downloads · last 90 days
5/day avg+442%
Top Dependents
Most downloaded crates that depend on wordchipper
Version Adoption
v0.8.1
28%
v0.8.0
27%
v0.9.0
19%
v0.5.6
14%
v0.7.3
12%
Release Timeline
27 releasessince 2026
J
F
M
A
M
J
J
A
S
O
N
D
2026
27
LessMore
Feature Flags
default =["std", "fast-hash", "parallel"]
std*clientdatagymtestingtracingdownloadparallel*fast-hash*concurrent
README
Loading README...
Maintainers
Dependencies
28
direct dependencies
Dependents
8
crates depend on wordchipper