rustio rustio.net

kitoken vs sentencepiece-rs vs trustformers-tokenizers

Side-by-side comparison of Rust crates

Core Metrics

kitokensentencepiece-rstrustformers-tokenizers
Health Score545655
Total Downloads46.9K27.1K793
30d Downloads000
Dependents233218
Releases3410
Last Updated152d ago142d ago45d ago
Age1y 9m5m11m

Health Breakdown

kitoken
Maintenance
10
Quality
16
Community
10
Popularity
6
Documentation
12
sentencepiece-rs
Maintenance
14
Quality
15
Community
9
Popularity
5
Documentation
13
trustformers-tokenizers
Maintenance
17
Quality
11
Community
9
Popularity
3
Documentation
15

Technical Details

kitokensentencepiece-rstrustformers-tokenizers
Version0.11.00.2.20.2.1
Stable (≥1.0)✗ No✗ No✗ No
LicenseBSD-2-ClauseApache-2.0Apache-2.0
Dependencies24035
Crate Size64KB22KB571KB
Features2109
Yanked %0.0%0.0%0.0%
Edition202420242021
MSRV1.86.0—1.89
Owners111

Quick Verdict

  • •sentencepiece-rs leads with a health score of 56/100, but none of the options score above 80.
  • •kitoken has the most downloads (46.9K), suggesting wider adoption.