rustio rustio.net

miktik vs llm-tokenizer vs dynamo-tokenizers

Side-by-side comparison of Rust crates

Core Metrics

miktikllm-tokenizerdynamo-tokenizers
Health Score576563
Total Downloads5.6K2.0M818.0K
30d Downloads000
Dependents04451
Releases111524
Last Updated36d ago1d ago3d ago
Age7m9m5m

Health Breakdown

miktik
Maintenance
17
Quality
16
Community
5
Popularity
4
Documentation
15
llm-tokenizer
Maintenance
22
Quality
14
Community
11
Popularity
8
Documentation
10
dynamo-tokenizers
Maintenance
20
Quality
14
Community
12
Popularity
7
Documentation
10

Technical Details

miktikllm-tokenizerdynamo-tokenizers
Version0.4.31.9.03.1.0
Stable (≥1.0)✗ No✓ Yes✓ Yes
LicenseMITApache-2.0Apache-2.0
Dependencies42416
Crate Size24KB242KB76KB
Features600
Yanked %0.0%0.0%0.0%
Edition202420212024
MSRV1.86——
Owners114

Quick Verdict

  • •llm-tokenizer leads with a health score of 65/100, but none of the options score above 80.
  • •miktik is pre-1.0 — API may change.