rustio rustio.net
47

wordchipper

v0.9.0 Experimental

HPC Rust LLM Tokenizer Library

MIT Edition 2024 MSRV 1.93.0
#ai#tokenizer#gpt#bpe

Quick Verdict

  • โœ“Actively maintained (updated 4d ago)
  • !Pre-1.0: API may have breaking changes
  • !Heavy dependency tree (28 direct deps)
  • โœ“Permissive license (MIT)

Security

Checking security advisories...
Downloads
442
Dependents
8
Releases
27
Size
259KB

Deep Insights

๐Ÿ“‰
Download decline

128 downloads in the last 30 days, down 60% from the previous period. May indicate migration to alternatives.

๐Ÿ“ฆ
Heavy dependency tree

28 direct dependencies. Consider the impact on compile times and supply chain complexity.

๐ŸŒŸ
Used by top crates

Notable dependents include wordchipper-training, wordchipper-cli-util, wordchipper-cli, wchipper. When high-quality crates choose wordchipper, it's a strong quality signal.

Health Breakdown

Maintenance 13/25

Recency, release consistency, active ratio

Quality 13/25

Yanked ratio, deps, size, maturity, features

Community 6/20

Reverse deps, ownership, ecosystem

Popularity 3/15

Downloads, momentum, growth trend

Documentation 12/15

Docs, repo, license, metadata

Download Trend

Daily downloads ยท last 90 days
5/day avg+442%
020406012/291/162/32/213/113/28

Top Dependents

Version Adoption

v0.8.1
28%
v0.8.0
27%
v0.9.0
19%
v0.5.6
14%
v0.7.3
12%

Release Timeline

27 releasessince 2026
J
F
M
A
M
J
J
A
S
O
N
D
2026
27
Less
More

Feature Flags

default =["std", "fast-hash", "parallel"]

std*clientdatagymtestingtracingdownloadparallel*fast-hash*concurrent

README

Loading README...

Maintainers

Dependencies
28
direct dependencies
Dependents
8
crates depend on wordchipper

Similar Crates