rustio rustio.net
51

sentencepiece-rust

v0.1.1 Experimental

From-scratch pure-Rust SentencePiece inference (encode/decode), differentially verified against the upstream C++/Python implementation.

Apache-2.0 Edition 2021 MSRV 1.70
Text processing #tokenizer#nlp#bpe#sentencepiece#unigram

Quick Verdict

  • !Pre-1.0: API may have breaking changes
  • โœ“Tiny footprint (480KB, 0 deps)
  • โœ“Permissive license (Apache-2.0)

Security

Checking security advisories...
Downloads
4.4K
Dependents
19
Releases
2
Size
480KB

Deep Insights

๐Ÿ“ˆ
Strong growth momentum

1.5K downloads in the last 30 days (51/day), up 24% from the previous period.

๐Ÿชถ
Zero dependencies

sentencepiece-rust has no external dependencies โ€” minimal supply chain risk and fast compile times.

๐ŸŒŸ
Used by top crates

Notable dependents include patronus-ark, maolan-generate, sacrebleu-rs. When high-quality crates choose sentencepiece-rust, it's a strong quality signal.

Health Breakdown

Maintenance 12/25

Recency, release consistency, active ratio

Quality 14/25

Yanked ratio, deps, size, maturity, features

Community 9/20

Reverse deps, ownership, ecosystem

Popularity 4/15

Downloads, momentum, growth trend

Documentation 12/15

Docs, repo, license, metadata

Download Trend

Daily downloads ยท last 90 days
2/day avg
0501001502008/239/109/2810/1611/311/20

Top Dependents

Most downloaded crates that depend on sentencepiece-rust

Version Adoption

v0.1.1
99%
v0.1.0
1%

Release Timeline

2 releasessince 2026
J
F
M
A
M
J
J
A
S
O
N
D
2026
2
Less
More

README

Loading README...

Maintainers

Dependencies
0
direct dependencies
Dependents
19
crates depend on sentencepiece-rust

Similar Crates