Decision Workspace
miktik vs llm-tokenizer vs vtcode-core
Side-by-side comparison of Rust crates
52
miktik
experimentalv0.2.0
A unified, multi-backend tokenizer library for LLMs
54
llm-tokenizer
experimentalv1.3.0
LLM tokenizer library with caching and chat template support
67
vtcode-core
experimentalv0.93.3
Core library for VT Code - a Rust-based terminal coding agent
Core Metrics
| miktik | llm-tokenizer | vtcode-core | |
|---|---|---|---|
| Health Score | 52 | 54 | 67 |
| Total Downloads | 1.1K | 189.4K | 30.1K |
| 30d Downloads | 983 | 121.1K | 1.1K |
| Dependents | 0 | 14 | 338 |
| Releases | 4 | 5 | 359 |
| Last Updated | 25d ago | 17d ago | 2d ago |
| Age | 1m | 2m | 6m |
Health Breakdown
miktik
Maintenance
12
Quality
16
Community
5
Popularity
4
Documentation
15
llm-tokenizer
Maintenance
16
Quality
13
Community
9
Popularity
6
Documentation
10
vtcode-core
Maintenance
23
Quality
11
Community
13
Popularity
5
Documentation
15
Technical Details
| miktik | llm-tokenizer | vtcode-core | |
|---|---|---|---|
| Version | 0.2.0 | 1.3.0 | 0.93.3 |
| Stable (≥1.0) | ✗ No | ✓ Yes | ✗ No |
| License | MIT | Apache-2.0 | MIT |
| Dependencies | 4 | 23 | 126 |
| Crate Size | 22KB | 101KB | 1.8MB |
| Features | 5 | 0 | 5 |
| Yanked % | 0.0% | 0.0% | 0.0% |
| Edition | 2024 | 2021 | 2024 |
| MSRV | 1.85 | — | 1.88 |
| Owners | 1 | 1 | 1 |
Links
Quick Verdict
- •vtcode-core leads with a health score of 67/100, but none of the options score above 80.
- •llm-tokenizer has the most downloads (189.4K), suggesting wider adoption.
- •vtcode-core is depended on by 338 crates — strongest ecosystem trust.
- •miktik, vtcode-core are pre-1.0 — API may change.