Decision Workspace
itok vs token-count vs utokenizer
Side-by-side comparison of Rust crates
51
itok
experimentalv0.3.1
context-cost estimator: token and window budgets for files and changes
48
token-count
experimentalv0.4.0
Count tokens for LLM models using exact tokenization
42
utokenizer
experimentalv0.1.1
CLI tool for building a local model-tokenizer registry and counting input tokens across model families.
Core Metrics
| itok | token-count | utokenizer | |
|---|---|---|---|
| Health Score | 51 | 48 | 42 |
| Total Downloads | 270 | 276 | 43 |
| 30d Downloads | 0 | 0 | 0 |
| Dependents | 8 | 0 | 0 |
| Releases | 3 | 5 | 2 |
| Last Updated | 49d ago | 209d ago | 176d ago |
| Age | 1m | 6m | 5m |
Health Breakdown
itok
Maintenance
11
Quality
13
Community
9
Popularity
3
Documentation
15
token-count
Maintenance
16
Quality
11
Community
6
Popularity
3
Documentation
12
utokenizer
Maintenance
9
Quality
12
Community
6
Popularity
2
Documentation
13
Technical Details
| itok | token-count | utokenizer | |
|---|---|---|---|
| Version | 0.3.1 | 0.4.0 | 0.1.1 |
| Stable (≥1.0) | ✗ No | ✗ No | ✗ No |
| License | MIT | MIT | MIT |
| Dependencies | 10 | 15 | 9 |
| Crate Size | 286KB | 339KB | 33KB |
| Features | 4 | 0 | 0 |
| Yanked % | 0.0% | 0.0% | 0.0% |
| Edition | 2024 | 2021 | 2021 |
| MSRV | 1.95 | 1.85.0 | — |
| Owners | 1 | 1 | 1 |
Links
Quick Verdict
- •itok leads with a health score of 51/100, but none of the options score above 80.
- •token-count has the most downloads (276), suggesting wider adoption.