rustio rustio.net
51

sentencepiece

v0.14.0 Growing

Binding for the sentencepiece tokenizer

MIT OR Apache-2.0 Edition 2018

Quick Verdict

  • βœ“Actively maintained (updated 75d ago)
  • !Pre-1.0: API may have breaking changes
  • βœ“Trusted by 164 crates
  • βœ“Permissive license (MIT OR Apache-2.0)

Security

Checking security advisories...
Downloads
960.4K
Dependents
164
Releases
29
Size
160KB

Deep Insights

πŸ“ˆ
Strong growth momentum

139.5K downloads in the last 30 days (4.7K/day), up 29% from the previous period.

πŸ”—
Moderate adoption

164 crates depend on sentencepiece. Reasonable ecosystem adoption, though not yet a core dependency.

πŸ‘€
Prolific maintainer

The primary maintainer publishes 56 crates. This suggests deep Rust expertise and long-term commitment to the ecosystem.

πŸ”¬
Pre-1.0 for over a year

Despite being 6+ years old, sentencepiece hasn't reached 1.0 yet. Expect potential API changes between versions.

🌟
Used by top crates

Notable dependents include ct2rs, moshi-server, syntaxdot-tokenizers, sticker2, moshi-cli. When high-quality crates choose sentencepiece, it's a strong quality signal.

Health Breakdown

Maintenance 14/25

Recency, release consistency, active ratio

Quality 14/25

Yanked ratio, deps, size, maturity, features

Community 7/20

Reverse deps, ownership, ecosystem

Popularity 7/15

Downloads, momentum, growth trend

Documentation 9/15

Docs, repo, license, metadata

Download Trend

Daily downloads Β· last 90 days
596/day avg-100%
02K4K6K8K10K8/239/109/2810/1611/311/20

Top Dependents

Version Adoption

v0.13.1
41%
v0.12.0
33%
v0.11.3
14%
v0.11.2
12%
v0.13.2
1%

Release Timeline

10 releasessince 2022
J
F
M
A
M
J
J
A
S
O
N
D
2022
1
2023
3
2024
2025
2
2026
4
Less
More

Feature Flags

staticsystemalbert-tests

README

Loading README...

Maintainers

Dependencies
7
direct dependencies
Dependents
164
crates depend on sentencepiece