rustio rustio.net

minbpe vs language-model-type vs tiktoken-rs

Side-by-side comparison of Rust crates

Core Metrics

minbpelanguage-model-typetiktoken-rs
Health Score324565
Total Downloads1.8K23.0K20.2M
30d Downloads000
Dependents0178.7K
Releases1636
Last Updated915d ago313d ago15d ago
Age2y 6m1y 6m3y 8m

Health Breakdown

minbpe
Maintenance
1
Quality
14
Community
3
Popularity
4
Documentation
10
language-model-type
Maintenance
8
Quality
13
Community
9
Popularity
5
Documentation
10
tiktoken-rs
Maintenance
18
Quality
12
Community
12
Popularity
8
Documentation
15

Technical Details

minbpelanguage-model-typetiktoken-rs
Version0.1.00.1.50.12.1
Stable (≥1.0)✗ No✗ No✗ No
LicenseMIT OR Apache-2.0MITMIT
Dependencies888
Crate Size856KB28KB3.8MB
Features502
Yanked %0.0%0.0%0.0%
Edition202120242024
MSRV——1.85.0
Owners111

Quick Verdict

  • •tiktoken-rs leads with a health score of 65/100, but none of the options score above 80.
  • •tiktoken-rs is depended on by 8.7K crates — strongest ecosystem trust.
  • •⚠ minbpe has not been updated in over a year.