rustio rustio.net

Decision Workspace

kitoken

Side-by-side comparison of Rust crates

58
kitoken
growingv0.11.0

Fast tokenizer for language models, supporting BPE, Unigram and WordPiece tokenization

Core Metrics

kitoken
Health Score58
Total Downloads38.7K
30d Downloads0
Dependents9
Releases3
Last Updated15d ago
Age1y 5m

Health Breakdown

kitoken
Maintenance
16
Quality
16
Community
9
Popularity
5
Documentation
12

Technical Details

kitoken
Version0.11.0
Stable (≥1.0)✗ No
LicenseBSD-2-Clause
Dependencies24
Crate Size64KB
Features21
Yanked %0.0%
Edition2024
MSRV1.86.0
Owners1

Links

kitoken detail →GitHub ↗crates.io ↗

Quick Verdict

  • •kitoken leads with a health score of 58/100, but none of the options score above 80.