rustio rustio.net
51

sentencepiece

v0.13.1 Growing

Binding for the sentencepiece tokenizer

MIT OR Apache-2.0 Edition 2018

Quick Verdict

  • βœ“Actively maintained (updated 69d ago)
  • !Pre-1.0: API may have breaking changes
  • βœ“Trusted by 119 crates
  • βœ“Permissive license (MIT OR Apache-2.0)

Security

Checking security advisories...
Downloads
468.1K
Dependents
119
Releases
27
Size
160KB

Deep Insights

πŸ“ˆ
Strong growth momentum

242.0K downloads in the last 30 days (8.1K/day), up 1439% from the previous period.

πŸ”—
Moderate adoption

119 crates depend on sentencepiece. Reasonable ecosystem adoption, though not yet a core dependency.

πŸ‘€
Prolific maintainer

The primary maintainer publishes 53 crates. This suggests deep Rust expertise and long-term commitment to the ecosystem.

πŸ”¬
Pre-1.0 for over a year

Despite being 6+ years old, sentencepiece hasn't reached 1.0 yet. Expect potential API changes between versions.

🌟
Used by top crates

Notable dependents include ct2rs, moshi-server, syntaxdot-tokenizers, sticker2, moshi-cli. When high-quality crates choose sentencepiece, it's a strong quality signal.

Health Breakdown

Maintenance 14/25

Recency, release consistency, active ratio

Quality 14/25

Yanked ratio, deps, size, maturity, features

Community 7/20

Reverse deps, ownership, ecosystem

Popularity 7/15

Downloads, momentum, growth trend

Documentation 9/15

Docs, repo, license, metadata

Download Trend

Daily downloads Β· last 90 days
3K/day avg+472%
020K40K60K12/291/162/32/213/113/28

Top Dependents

Version Adoption

v0.12.0
58%
v0.11.2
22%
v0.11.3
17%
v0.9.0
2%
v0.13.1
1%

Release Timeline

27 releases1 yankedsince 2020
J
F
M
A
M
J
J
A
S
O
N
D
2020
12
2021
4
2022
4
2023
3
2024
2025
2
2026
2
Less
More|
Yanked

Feature Flags

staticsystemalbert-tests

README

Loading README...

Maintainers

Dependencies
7
direct dependencies
Dependents
119
crates depend on sentencepiece