rustio rustio.net

llm-tokenizer vs dynamo-tokenizers vs miktik

Side-by-side comparison of Rust crates

Core Metrics

llm-tokenizerdynamo-tokenizersmiktik
Health Score656357
Total Downloads2.0M818.0K5.6K
30d Downloads000
Dependents44510
Releases152411
Last Updated1d ago3d ago36d ago
Age9m5m7m

Health Breakdown

llm-tokenizer
Maintenance
22
Quality
14
Community
11
Popularity
8
Documentation
10
dynamo-tokenizers
Maintenance
20
Quality
14
Community
12
Popularity
7
Documentation
10
miktik
Maintenance
17
Quality
16
Community
5
Popularity
4
Documentation
15

Technical Details

llm-tokenizerdynamo-tokenizersmiktik
Version1.9.03.1.00.4.3
Stable (≥1.0)✓ Yes✓ Yes✗ No
LicenseApache-2.0Apache-2.0MIT
Dependencies24164
Crate Size242KB76KB24KB
Features006
Yanked %0.0%0.0%0.0%
Edition202120242024
MSRV——1.86
Owners141

Quick Verdict

  • •llm-tokenizer leads with a health score of 65/100, but none of the options score above 80.
  • •miktik is pre-1.0 — API may change.